Nov 21 14:11:08 user devstack@n-api.service[64451]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 21 14:11:08 user devstack@n-api.service[64451]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 21 14:11:08 2023] *** Nov 21 14:11:08 user devstack@n-api.service[64451]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 21 14:11:08 user devstack@n-api.service[64451]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 21 14:11:08 user devstack@n-api.service[64451]: nodename: user Nov 21 14:11:08 user devstack@n-api.service[64451]: machine: x86_64 Nov 21 14:11:08 user devstack@n-api.service[64451]: clock source: unix Nov 21 14:11:08 user devstack@n-api.service[64451]: pcre jit disabled Nov 21 14:11:08 user devstack@n-api.service[64451]: detected number of CPU cores: 12 Nov 21 14:11:08 user devstack@n-api.service[64451]: current working directory: / Nov 21 14:11:08 user devstack@n-api.service[64451]: detected binary path: /usr/bin/uwsgi-core Nov 21 14:11:08 user devstack@n-api.service[64451]: your processes number limit is 63589 Nov 21 14:11:08 user devstack@n-api.service[64451]: your memory page size is 4096 bytes Nov 21 14:11:08 user devstack@n-api.service[64451]: detected max file descriptor number: 2048 Nov 21 14:11:08 user devstack@n-api.service[64451]: lock engine: pthread robust mutexes Nov 21 14:11:08 user devstack@n-api.service[64451]: thunder lock: enabled Nov 21 14:11:08 user devstack@n-api.service[64451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 21 14:11:08 user devstack@n-api.service[64451]: Python version: 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] Nov 21 14:11:08 user devstack@n-api.service[64451]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 21 14:11:08 user devstack@n-api.service[64451]: Set PythonHome to /opt/stack/data/venv Nov 21 14:11:08 user devstack@n-api.service[64451]: Python main interpreter initialized at 0x5575b94c7b90 Nov 21 14:11:08 user devstack@n-api.service[64451]: python threads support enabled Nov 21 14:11:08 user devstack@n-api.service[64451]: your server socket listen backlog is limited to 100 connections Nov 21 14:11:08 user devstack@n-api.service[64451]: your mercy for graceful operations on workers is 80 seconds Nov 21 14:11:08 user devstack@n-api.service[64451]: mapped 537436 bytes (524 KB) for 3 cores Nov 21 14:11:08 user devstack@n-api.service[64451]: *** Operational MODE: preforking *** Nov 21 14:11:08 user devstack@n-api.service[64451]: *** uWSGI is running in multiple interpreter mode *** Nov 21 14:11:08 user devstack@n-api.service[64451]: spawned uWSGI master process (pid: 64451) Nov 21 14:11:08 user devstack@n-api.service[64451]: spawned uWSGI worker 1 (pid: 64452, cores: 1) Nov 21 14:11:08 user devstack@n-api.service[64451]: spawned uWSGI worker 2 (pid: 64453, cores: 1) Nov 21 14:11:08 user devstack@n-api.service[64451]: spawned uWSGI worker 3 (pid: 64454, cores: 1) Nov 21 14:11:08 user devstack@n-api.service[64451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 21 14:11:12 user devstack@n-api.service[64453]: live_migration_uri is deprecated for removal in favor of two other options that Nov 21 14:11:12 user devstack@n-api.service[64453]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 21 14:11:12 user devstack@n-api.service[64453]: and ``live_migration_inbound_addr`` respectively. Nov 21 14:11:12 user devstack@n-api.service[64453]: ). Its value may be silently ignored in the future. Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 21 14:11:12 user devstack@n-api.service[64452]: live_migration_uri is deprecated for removal in favor of two other options that Nov 21 14:11:12 user devstack@n-api.service[64452]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 21 14:11:12 user devstack@n-api.service[64452]: and ``live_migration_inbound_addr`` respectively. Nov 21 14:11:12 user devstack@n-api.service[64452]: ). Its value may be silently ignored in the future. Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 21 14:11:12 user devstack@n-api.service[64454]: live_migration_uri is deprecated for removal in favor of two other options that Nov 21 14:11:12 user devstack@n-api.service[64454]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 21 14:11:12 user devstack@n-api.service[64454]: and ``live_migration_inbound_addr`` respectively. Nov 21 14:11:12 user devstack@n-api.service[64454]: ). Its value may be silently ignored in the future. Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64452) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: INFO dbcounter [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Registered counter for database nova_api Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_db.sqlalchemy.engines [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writer thread running {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=64454) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG nova.context [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff78a6a6-5ef0-4832-8292-72647bc96a63(cell1) {{(pid=64453) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64452]: INFO dbcounter [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Registered counter for database nova_api Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64453]: INFO dbcounter [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64453]: INFO dbcounter [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Registered counter for database nova_cell1 Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_db.sqlalchemy.engines [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_db.sqlalchemy.engines [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writer thread running {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writer thread running {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_db.sqlalchemy.engines [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64452) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writer thread running {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64454]: INFO dbcounter [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Registered counter for database nova_api Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writer thread running {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG nova.context [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff78a6a6-5ef0-4832-8292-72647bc96a63(cell1) {{(pid=64452) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64452]: INFO dbcounter [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64452]: INFO dbcounter [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Registered counter for database nova_cell1 Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_db.sqlalchemy.engines [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64452) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writer thread running {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_db.sqlalchemy.engines [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64452) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG nova.context [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff78a6a6-5ef0-4832-8292-72647bc96a63(cell1) {{(pid=64454) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:11:12 user devstack@n-api.service[64454]: INFO dbcounter [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64454]: INFO dbcounter [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Registered counter for database nova_cell1 Nov 21 14:11:12 user devstack@n-api.service[64453]: INFO dbcounter [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writer thread running {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG oslo_db.sqlalchemy.engines [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writer thread running {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writer thread running {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64452]: INFO dbcounter [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG oslo_db.sqlalchemy.engines [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64452) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writer thread running {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writer thread running {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:12 user devstack@n-api.service[64454]: INFO dbcounter [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Registered counter for database nova_cell0 Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=64454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 21 14:11:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writer thread running {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 21 14:11:13 user devstack@n-api.service[64453]: WARNING keystonemiddleware.auth_token [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64453]: WARNING keystonemiddleware.auth_token [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64452]: WARNING keystonemiddleware.auth_token [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64452]: WARNING keystonemiddleware.auth_token [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64453]: WARNING keystonemiddleware.auth_token [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64453]: WARNING keystonemiddleware.auth_token [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5575b94c7b90 pid: 64453 (default app) Nov 21 14:11:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:11:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001412 Nov 21 14:11:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 21 14:11:13 2023] GET /compute/v2.1/ => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:11:13 user devstack@n-api.service[64454]: WARNING keystonemiddleware.auth_token [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64454]: WARNING keystonemiddleware.auth_token [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64452]: WARNING keystonemiddleware.auth_token [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64452]: WARNING keystonemiddleware.auth_token [None req-e55bcb64-bdd3-4674-86d9-36bc9357afdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64452]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5575b94c7b90 pid: 64452 (default app) Nov 21 14:11:13 user devstack@n-api.service[64454]: WARNING keystonemiddleware.auth_token [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 14:11:13 user devstack@n-api.service[64454]: WARNING keystonemiddleware.auth_token [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 14:11:13 user devstack@n-api.service[64454]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5575b94c7b90 pid: 64454 (default app) Nov 21 14:13:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ef82b55e-2a94-4e55-a7f0-9c7e8f6e6b25 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001687 Nov 21 14:13:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-fedc07b2-73d8-4257-b024-beb73a4931a5 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-fedc07b2-73d8-4257-b024-beb73a4931a5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.407636 Nov 21 14:13:23 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 21 14:13:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002035 Nov 21 14:13:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:24 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:25 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-850cb532-bbcc-4c6a-82ad-f2a4f14d6e56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:25 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-850cb532-bbcc-4c6a-82ad-f2a4f14d6e56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.386996 Nov 21 14:13:25 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:24 2023] POST /compute/v2.1/flavors => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ad267714-330a-42a6-a60c-2d368a2f4b62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ad267714-330a-42a6-a60c-2d368a2f4b62 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043898 Nov 21 14:13:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 21 14:13:25 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:27 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:27 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001284 Nov 21 14:13:27 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-07fef200-458d-4c3d-98da-c75079963d52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 5, "swap": 0, "id": "d1"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-07fef200-458d-4c3d-98da-c75079963d52 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068068 Nov 21 14:13:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:27 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ce2ac91b-d5a1-481c-a0dd-403a4763fd7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ce2ac91b-d5a1-481c-a0dd-403a4763fd7a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030509 Nov 21 14:13:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 21 14:13:27 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001866 Nov 21 14:13:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:29 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7b931a8f-49b6-4d92-9a52-cd072944bdd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7b931a8f-49b6-4d92-9a52-cd072944bdd8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070754 Nov 21 14:13:29 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:29 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-db385258-5d82-4a9f-8b1f-8b03b8f412f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-db385258-5d82-4a9f-8b1f-8b03b8f412f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026413 Nov 21 14:13:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 21 14:13:29 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001592 Nov 21 14:13:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-be4bc6d9-b593-4ed5-915a-4daeed630ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-be4bc6d9-b593-4ed5-915a-4daeed630ba0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068274 Nov 21 14:13:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b27d9406-99d1-4eed-a526-562bea05cabc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b27d9406-99d1-4eed-a526-562bea05cabc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038170 Nov 21 14:13:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 21 14:13:31 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:33 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:33 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001365 Nov 21 14:13:33 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1a8c2aa1-a0fd-47f0-abe4-0472c7775a85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1a8c2aa1-a0fd-47f0-abe4-0472c7775a85 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.109497 Nov 21 14:13:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025190 Nov 21 14:13:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 21 14:13:33 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a5b3cabd-2be1-4b0e-b90a-bdf17d49749e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001420 Nov 21 14:13:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:35 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7d101daf-e81f-4fa5-b7b1-8e0b17611a7e admin admin] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7d101daf-e81f-4fa5-b7b1-8e0b17611a7e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.076110 Nov 21 14:13:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 21 14:13:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:13:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001708 Nov 21 14:13:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:13:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-62f39363-9f6c-40c6-97cf-d6bffb626f31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-62f39363-9f6c-40c6-97cf-d6bffb626f31 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.326275 Nov 21 14:13:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:37 2023] POST /compute/v2.1/flavors => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-151cbe8f-859c-406e-93c4-6df71c67e71a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-151cbe8f-859c-406e-93c4-6df71c67e71a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.182209 Nov 21 14:13:38 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 21 14:13:37 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:13:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001346 Nov 21 14:13:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:40 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-90886162-6378-4596-b78f-cb6454ca2ef9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-90886162-6378-4596-b78f-cb6454ca2ef9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.084868 Nov 21 14:13:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:40 2023] POST /compute/v2.1/flavors => generated 403 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8916a46d-f977-4f52-ae17-47f77417d3ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8916a46d-f977-4f52-ae17-47f77417d3ea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025982 Nov 21 14:13:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 21 14:13:40 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001329 Nov 21 14:13:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-429ea7e4-93b6-425b-ad13-0d09709acd74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-429ea7e4-93b6-425b-ad13-0d09709acd74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063480 Nov 21 14:13:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:42 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-61daa3ca-9225-449d-b7b1-fe5cb8835bff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-61daa3ca-9225-449d-b7b1-fe5cb8835bff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023877 Nov 21 14:13:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 21 14:13:42 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001372 Nov 21 14:13:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b3554506-80fd-4805-b7c9-9d9b42b9f42c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "swap": 0}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b3554506-80fd-4805-b7c9-9d9b42b9f42c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061897 Nov 21 14:13:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ee33fa47-922a-485c-90c4-ae9ca572965d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ee33fa47-922a-485c-90c4-ae9ca572965d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027250 Nov 21 14:13:44 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 21 14:13:44 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:13:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:13:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002599 Nov 21 14:13:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 21 14:13:46 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:13:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-509c91eb-a6ce-4fec-9888-37afff82ac28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "rxtx_factor": 1.0}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-509c91eb-a6ce-4fec-9888-37afff82ac28 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071229 Nov 21 14:13:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 21 14:13:46 2023] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:13:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7866d4f1-ffe5-48ee-97ca-8a21abde1709 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:13:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7866d4f1-ffe5-48ee-97ca-8a21abde1709 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025911 Nov 21 14:13:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 21 14:13:46 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:14:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a5d3177-04b5-41b6-9d51-18b55a4c1a74 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001486 Nov 21 14:14:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 21 14:14:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:14:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:14:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.094567 Nov 21 14:14:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 21 14:14:19 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:14:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7866d4f1-ffe5-48ee-97ca-8a21abde1709 admin admin] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7866d4f1-ffe5-48ee-97ca-8a21abde1709 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002884 Nov 21 14:14:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 21 14:14:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:14:49 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-601405fe-f6d4-45a6-9ef3-1cd29b6b4890 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-601405fe-f6d4-45a6-9ef3-1cd29b6b4890 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.070346 Nov 21 14:14:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 21 14:14:49 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:14:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-20269fcc-aa79-4613-87ee-142485b8aedb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001604 Nov 21 14:14:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 21 14:14:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:14:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-93387228-11d4-442c-ae97-456e69d90e15 admin admin] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-93387228-11d4-442c-ae97-456e69d90e15 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.060138 Nov 21 14:14:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 21 14:14:52 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:14:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-601405fe-f6d4-45a6-9ef3-1cd29b6b4890 admin admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-601405fe-f6d4-45a6-9ef3-1cd29b6b4890 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002312 Nov 21 14:14:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 21 14:14:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:14:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:14:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-772c36d9-6c27-421e-9fd2-c017a1cb8200 admin admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:14:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-772c36d9-6c27-421e-9fd2-c017a1cb8200 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.070036 Nov 21 14:14:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 21 14:14:54 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:17:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1455144124", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b"}]}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:24 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] validate_networks() for [('fd9e560f-4f37-4aa6-8f88-8dbb8870100b', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Getting quotas for project df1a7387e11d461088e466338a2804e2. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Getting quotas for user d20e3b99a4f246eb89174a4e87e5da4a and project df1a7387e11d461088e466338a2804e2. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:25 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:25 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.813287 Nov 21 14:17:25 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:17:26 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:26 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-962646a8-e77c-400b-a978-86c4ac36235e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:26 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-962646a8-e77c-400b-a978-86c4ac36235e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:26 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:26 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-962646a8-e77c-400b-a978-86c4ac36235e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3b99a4f246eb89174a4e87e5da4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a7387e11d461088e466338a2804e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-962646a8-e77c-400b-a978-86c4ac36235e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 200 len: 1207 microversion: 2.1 time: 0.525075 Nov 21 14:17:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 15/45] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:26 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 1207 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716976770", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "a9ab1c2c-271a-4606-b53d-a309e4992de9"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:26 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] validate_networks() for [('a9ab1c2c-271a-4606-b53d-a309e4992de9', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting quotas for project 8612dc478d4a40babe74b1fbf45eac93. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting quotas for user ec7d58eda515420f8b815338d2efd377 and project 8612dc478d4a40babe74b1fbf45eac93. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:29 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:30 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.586872 Nov 21 14:17:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 3590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:17:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-13ce990d-7775-4a9f-8853-94862629cfdb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-13ce990d-7775-4a9f-8853-94862629cfdb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:30 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-13ce990d-7775-4a9f-8853-94862629cfdb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-13ce990d-7775-4a9f-8853-94862629cfdb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1208 microversion: 2.1 time: 0.312845 Nov 21 14:17:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:30 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1208 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Creating event network-changed:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64452) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Acquired lock "compute-rpcapi-router" {{(pid=64452) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:31 user devstack@n-api.service[64452]: INFO nova.compute.rpcapi [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 21 14:17:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] Releasing lock "compute-rpcapi-router" {{(pid=64452) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 21 14:17:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f6836291-6b14-437f-97dc-04ca7ae6c2fd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188124 Nov 21 14:17:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 16/48] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1c12ad37-44fc-43ed-9d03-cf1773b2522d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: .version_select at 0x7f76b2157eb0>, body: {"keypair": {"name": "tempest-keypair-1671638300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4a0f6f14-93e6-47dc-b59e-f5e9eba3ad50 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: .version_select at 0x7f76b21656c0>, body: {"keypair": {"name": "tempest-keypair-505302143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwY//FreJ5qDC5lWo3bwL5cUVIrBloEThhGKinIL+Dcf3C1HRYL3HegVVTngLnHoOvc8ShLJ5l6nAqbLePxabslB+xeTUT15JkeNlYIhWq4vIcEL9qSUPo7AAdHWi+/Ag=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:32 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-1c12ad37-44fc-43ed-9d03-cf1773b2522d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for project 894802e2e3d044199467be931dd8e036. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:32 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-1c12ad37-44fc-43ed-9d03-cf1773b2522d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for user c0cb90d4bdf74f9390124833ea8331bd and project 894802e2e3d044199467be931dd8e036. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:32 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-4a0f6f14-93e6-47dc-b59e-f5e9eba3ad50 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:32 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-4a0f6f14-93e6-47dc-b59e-f5e9eba3ad50 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1c12ad37-44fc-43ed-9d03-cf1773b2522d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299162 Nov 21 14:17:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 18/49] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:17:32 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4a0f6f14-93e6-47dc-b59e-f5e9eba3ad50 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.422685 Nov 21 14:17:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:17:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-478bed28-7452-4ab2-ac28-f80c082582a5 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: .version_select at 0x7f76b2381ea0>, body: {"keypair": {"name": "tempest-keypair-367225751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:32 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-478bed28-7452-4ab2-ac28-f80c082582a5 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:32 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-478bed28-7452-4ab2-ac28-f80c082582a5 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-478bed28-7452-4ab2-ac28-f80c082582a5 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247288 Nov 21 14:17:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:17:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Creating event network-changed:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:37 user devstack@n-api.service[64453]: INFO nova.compute.rpcapi [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 21 14:17:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] Releasing lock "compute-rpcapi-router" {{(pid=64453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 21 14:17:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-129d9dfa-1ac3-41ad-860c-52f29f10736b None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188515 Nov 21 14:17:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 19/52] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-430908517", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87"}], "security_groups": [{"name": "tempest-securitygroup--973081548"}], "key_name": "tempest-keypair-505302143", "user_data": "}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:37 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] validate_networks() for [('3ee5933d-610e-4e1b-91f4-1b2cceb04f87', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-70492316", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "04f88176-57de-4a45-96e0-55319f3d0f1f"}], "security_groups": [{"name": "tempest-securitygroup--986526616"}], "key_name": "tempest-keypair-1671638300", "user_data": "}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:38 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-30554362", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "af07711f-e1bf-40bf-9cdc-f912efa55fcd"}], "security_groups": [{"name": "tempest-securitygroup--1877222913"}], "key_name": "tempest-keypair-367225751", "user_data": "}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.375626 Nov 21 14:17:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:37 2023] POST /compute/v2.1/servers => generated 399 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fe4872e2-0f3d-4d76-8fee-db726e72a5e6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:38 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fe4872e2-0f3d-4d76-8fee-db726e72a5e6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:39 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-fe4872e2-0f3d-4d76-8fee-db726e72a5e6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fe4872e2-0f3d-4d76-8fee-db726e72a5e6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 200 len: 1232 microversion: 2.1 time: 0.239507 Nov 21 14:17:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:38 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 1232 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:39 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] validate_networks() for [('af07711f-e1bf-40bf-9cdc-f912efa55fcd', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:39 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] validate_networks() for [('04f88176-57de-4a45-96e0-55319f3d0f1f', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:40 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.596280 Nov 21 14:17:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:38 2023] POST /compute/v2.1/servers => generated 407 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 21 14:17:40 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-44dcb97e-336b-4a82-bb2b-7ff303b5420b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-44dcb97e-336b-4a82-bb2b-7ff303b5420b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:40 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-44dcb97e-336b-4a82-bb2b-7ff303b5420b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-44dcb97e-336b-4a82-bb2b-7ff303b5420b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1230 microversion: 2.1 time: 0.144816 Nov 21 14:17:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:40 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1230 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for project 894802e2e3d044199467be931dd8e036. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for user c0cb90d4bdf74f9390124833ea8331bd and project 894802e2e3d044199467be931dd8e036. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.528276 Nov 21 14:17:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:17:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dbb5e1f8-fddf-4706-9b5e-0f22ed67893d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-dbb5e1f8-fddf-4706-9b5e-0f22ed67893d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:41 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-dbb5e1f8-fddf-4706-9b5e-0f22ed67893d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dbb5e1f8-fddf-4706-9b5e-0f22ed67893d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1228 microversion: 2.1 time: 0.153762 Nov 21 14:17:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 21/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:41 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Creating event network-changed:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=64454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Acquired lock "compute-rpcapi-router" {{(pid=64454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:46 user devstack@n-api.service[64454]: INFO nova.compute.rpcapi [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 21 14:17:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] Releasing lock "compute-rpcapi-router" {{(pid=64454) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 21 14:17:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c91016e3-0db0-403e-9908-509fd4ecadfd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132110 Nov 21 14:17:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Creating event network-changed:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:17:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Nov 21 14:17:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 19/60] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=7 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=20 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:51 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Creating event network-changed:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:17:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182916 Nov 21 14:17:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 22/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:53 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=20 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-63d0c91e-caac-4e78-866e-13942c0fd500 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Action: 'create', calling method: .version_select at 0x7f76b18141f0>, body: {"keypair": {"name": "tempest-keypair-1966473581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDJcP9bpfqyVfwqPqOZyspaUE/J2iSeVHMJqrkSft/En7JrwcVC3zqiSI5oD9SXW88j/ds3f/l+tqb3Zp3UNXzjHvRgqaH1GU8gFw+zAqyYFNe7nwZO6YW1S7+oCrcVpw=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:53 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-63d0c91e-caac-4e78-866e-13942c0fd500 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting quotas for project 4b7c11f81daa43449a6e96e3a20aa06e. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:53 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-63d0c91e-caac-4e78-866e-13942c0fd500 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting quotas for user a9144e297f5b43a181844d967adcebae and project 4b7c11f81daa43449a6e96e3a20aa06e. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-63d0c91e-caac-4e78-866e-13942c0fd500 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150584 Nov 21 14:17:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:17:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:54 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:54 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-548bd645-0b1c-4bff-a83f-2d6287d95914 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Action: 'create', calling method: .version_select at 0x7f76b219bc70>, body: {"keypair": {"name": "tempest-keypair-2090548767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNovnpySsk3U0Q8+6LE0jiFBVTtkEvGsSDriJ5AOb/mzU9zamNWZhEW+zvPNYWK/cq/0aVIY6jPkY2qVS+L+dk7lkr/cLCQgfbWINSCyPIASxIiL1t7Y3W5GSsYQulzqMA=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:54 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-548bd645-0b1c-4bff-a83f-2d6287d95914 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting quotas for project ff93a19129c54087a14dde51cdd7b4dc. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:54 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-548bd645-0b1c-4bff-a83f-2d6287d95914 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting quotas for user 9642feeb69a74dec89b9123a2afb4bba and project ff93a19129c54087a14dde51cdd7b4dc. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-548bd645-0b1c-4bff-a83f-2d6287d95914 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.427374 Nov 21 14:17:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 20/63] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:17:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-913422417", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57"}], "security_groups": [{"name": "tempest-securitygroup--1360089857"}], "key_name": "tempest-keypair-1966473581", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:57 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] validate_networks() for [('ba264b79-eb59-49d9-b15a-8a7aea9d0d57', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting quotas for project 4b7c11f81daa43449a6e96e3a20aa06e. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting quotas for user a9144e297f5b43a181844d967adcebae and project 4b7c11f81daa43449a6e96e3a20aa06e. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:17:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.485538 Nov 21 14:17:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 23/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:17:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f9378848-6bfb-416a-9d03-95b1ee8adffe tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:17:58 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f9378848-6bfb-416a-9d03-95b1ee8adffe tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "name": "network-vif-plugged", "status": "completed", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Creating event network-vif-plugged:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:17:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175896 Nov 21 14:17:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:17:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:17:58 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f9378848-6bfb-416a-9d03-95b1ee8adffe tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9144e297f5b43a181844d967adcebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7c11f81daa43449a6e96e3a20aa06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:17:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f9378848-6bfb-416a-9d03-95b1ee8adffe tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a" status: 200 len: 1223 microversion: 2.1 time: 0.157850 Nov 21 14:17:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 21/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:17:58 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:17:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1065534804", "imageRef": "390b3cc6-3bd3-4725-8892-588039943890", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "ac66118d-d7f7-4ea5-9867-17c6981992ab"}], "security_groups": [{"name": "tempest-securitygroup--2004292820"}], "key_name": "tempest-keypair-2090548767", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] validate_networks() for [('ac66118d-d7f7-4ea5-9867-17c6981992ab', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting quotas for project ff93a19129c54087a14dde51cdd7b4dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting quotas for user 9642feeb69a74dec89b9123a2afb4bba and project ff93a19129c54087a14dde51cdd7b4dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:17:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='390b3cc6-3bd3-4725-8892-588039943890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.370361 Nov 21 14:18:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 24/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:17:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f7adbe4b-e146-450f-a293-121f848b1be3 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f7adbe4b-e146-450f-a293-121f848b1be3 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ea3f2ff1-a300-48bf-8929-1828ed0b30a1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Action: 'create', calling method: .version_select at 0x7f76b219bd00>, body: {"keypair": {"name": "tempest-keypair-733819265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:00 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ea3f2ff1-a300-48bf-8929-1828ed0b30a1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting quotas for project 1525a2b149ed40f9b3bbd98d1792a84c. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:00 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ea3f2ff1-a300-48bf-8929-1828ed0b30a1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting quotas for user ed0c9acb0c4a42beb3c41ba4ab44c4a8 and project 1525a2b149ed40f9b3bbd98d1792a84c. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f7adbe4b-e146-450f-a293-121f848b1be3 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9642feeb69a74dec89b9123a2afb4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff93a19129c54087a14dde51cdd7b4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f7adbe4b-e146-450f-a293-121f848b1be3 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 200 len: 1238 microversion: 2.1 time: 0.193513 Nov 21 14:18:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:00 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 1238 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ea3f2ff1-a300-48bf-8929-1828ed0b30a1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.208325 Nov 21 14:18:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 22/69] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:18:00 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:18:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "name": "network-vif-plugged", "status": "completed", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}, {"server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "name": "network-vif-plugged", "status": "completed", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}, {"server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "name": "network-vif-plugged", "status": "completed", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}, {"server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "name": "network-vif-plugged", "status": "completed", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}, {"server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "name": "network-vif-plugged", "status": "completed", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Creating event network-vif-plugged:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Creating event network-vif-plugged:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Creating event network-vif-plugged:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Creating event network-vif-plugged:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Creating event network-vif-plugged:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:18:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.101381 Nov 21 14:18:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e6672b73-c0e1-4b5c-bb58-7bfa8480902b tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Action: 'create', calling method: .version_select at 0x7f76b1815480>, body: {"keypair": {"name": "tempest-keypair-973639123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV8N4yxgVdRK01HFQutOwIthgXgkPWXkxVyqR+v6m5FqX2aGorRcylsw/cgdGD2IG97g8ccahhSe3hr9g6DETMsjzk7+mOHR15NMLkKTmEAGzpf8HO0/oLIlhzWj8oQMw=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e6672b73-c0e1-4b5c-bb58-7bfa8480902b tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Getting quotas for project f462575fd893488d8e31ba67b58a1879. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:00 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e6672b73-c0e1-4b5c-bb58-7bfa8480902b tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Getting quotas for user 75ff0e0266134eb7abca050cf13030aa and project f462575fd893488d8e31ba67b58a1879. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e6672b73-c0e1-4b5c-bb58-7bfa8480902b tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.289126 Nov 21 14:18:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:18:00 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:18:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1480492247", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c"}], "security_groups": [{"name": "tempest-securitygroup--1650682573"}], "key_name": "tempest-keypair-733819265", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-1717958769", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "cc215826-b43e-4bbe-b2c6-d31fce3e0337"}], "security_groups": [{"name": "tempest-securitygroup--1973169794"}], "key_name": "tempest-keypair-973639123", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:02 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] validate_networks() for [('e15ffa5f-4555-47e7-9a6b-827621cc2a3c', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] validate_networks() for [('cc215826-b43e-4bbe-b2c6-d31fce3e0337', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Getting quotas for project f462575fd893488d8e31ba67b58a1879. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Getting quotas for user 75ff0e0266134eb7abca050cf13030aa and project f462575fd893488d8e31ba67b58a1879. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:18:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:18:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.936135 Nov 21 14:18:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 26/72] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:18:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:18:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-34cc05ee-28ce-43eb-9789-ea87bb075f8c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-34cc05ee-28ce-43eb-9789-ea87bb075f8c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:03 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-34cc05ee-28ce-43eb-9789-ea87bb075f8c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ff0e0266134eb7abca050cf13030aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462575fd893488d8e31ba67b58a1879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-34cc05ee-28ce-43eb-9789-ea87bb075f8c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" status: 200 len: 1237 microversion: 2.1 time: 0.071738 Nov 21 14:18:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 25/73] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:03 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting quotas for project 1525a2b149ed40f9b3bbd98d1792a84c. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting quotas for user ed0c9acb0c4a42beb3c41ba4ab44c4a8 and project 1525a2b149ed40f9b3bbd98d1792a84c. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:18:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:18:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.863335 Nov 21 14:18:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 23/74] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:18:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:18:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Creating event network-changed:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:18:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057948 Nov 21 14:18:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ffd40fea-7ba7-46ec-acae-5fc6082004c9 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 200 len: 1320 microversion: 2.49 time: 0.167896 Nov 21 14:18:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 27/76] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:18:04 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:18:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Creating event network-changed:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:18:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071697 Nov 21 14:18:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 24/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Creating event network-changed:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:18:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058632 Nov 21 14:18:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Creating event network-changed:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:18:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086359 Nov 21 14:18:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "name": "network-vif-plugged", "status": "completed", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}, {"server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "name": "network-vif-plugged", "status": "completed", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Creating event network-vif-plugged:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:18:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Creating event network-vif-plugged:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:18:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038205 Nov 21 14:18:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 25/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "name": "network-vif-plugged", "status": "completed", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}, {"server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "name": "network-vif-plugged", "status": "completed", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Creating event network-vif-plugged:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:18:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Creating event network-vif-plugged:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:18:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101393 Nov 21 14:18:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=20 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}, {"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Creating event network-vif-plugged:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:18:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Creating event network-vif-plugged:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:18:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066081 Nov 21 14:18:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=16 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:17 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3b99a4f246eb89174a4e87e5da4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a7387e11d461088e466338a2804e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b4ee3b91-7191-4a35-9db4-fb41c25c2196 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 200 len: 1488 microversion: 2.1 time: 0.621593 Nov 21 14:18:17 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 26/83] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:16 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 1488 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:20 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fb89b520-2c58-47cc-ba8e-9efa252a6f49 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1492 microversion: 2.1 time: 0.483856 Nov 21 14:18:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 29/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:20 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1492 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=9 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "name": "network-vif-plugged", "status": "completed", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Creating event network-vif-plugged:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:18:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069290 Nov 21 14:18:26 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 30/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "name": "network-vif-plugged", "status": "completed", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}, {"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}, {"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}, {"server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "name": "network-vif-plugged", "status": "completed", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}, {"server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "name": "network-vif-plugged", "status": "completed", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Creating event network-vif-plugged:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Creating event network-vif-plugged:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Creating event network-vif-plugged:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:18:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.215540 Nov 21 14:18:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 27/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:28 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:29 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9add17c8-f04d-49d0-8798-531235c83e75 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 200 len: 1540 microversion: 2.1 time: 0.477859 Nov 21 14:18:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:29 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 1540 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:31 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-620de558-a7b1-4c46-acde-afe3cb613109 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1539 microversion: 2.1 time: 0.711195 Nov 21 14:18:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 31/88] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:30 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1539 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:31 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a0bf0e93-80cc-4eb7-9e1a-7c0c64d1c8c8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1533 microversion: 2.1 time: 0.255332 Nov 21 14:18:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 28/89] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:31 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1533 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-bbdf86bf-1b40-445b-b790-7f17fa7ad7a4 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Action: 'create', calling method: .version_select at 0x7f76b362a8c0>, body: {"keypair": {"name": "tempest-keypair-1419935771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:37 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-bbdf86bf-1b40-445b-b790-7f17fa7ad7a4 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting quotas for project 76e3715d8166472e843d6a046fc819c6. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:37 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-bbdf86bf-1b40-445b-b790-7f17fa7ad7a4 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting quotas for user 80a5b85d5cdf4f8c9fb662c6e04b74fb and project 76e3715d8166472e843d6a046fc819c6. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-bbdf86bf-1b40-445b-b790-7f17fa7ad7a4 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.049525 Nov 21 14:18:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 31/90] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:18:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:18:39 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-43172401", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "86bf0a81-542a-451d-8a26-2242103f9498"}, {"port": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "tag": "port-1"}, {"port": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "tag": "port-2"}, {"uuid": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "tag": "net-1"}, {"uuid": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43"}, {"uuid": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "61b0d03a-6007-4a40-858a-33490851ad91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "51ffdcef-a58a-4101-a967-2a66ec25ad93", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "edecdce9-a757-4671-8c6f-72b9d5048db1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--278460999"}], "key_name": "tempest-keypair-1419935771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:39 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] validate_networks() for [('86bf0a81-542a-451d-8a26-2242103f9498', None, None, None, None, None), (None, None, '2da6bd78-a4c0-4728-81e0-853c89c882fe', None, None, None), (None, None, '3bff0e3f-5977-4912-8998-ee250fc4ab87', None, None, None), ('157a66d1-5ace-4b08-9acc-b0d8f3b37e43', None, None, None, None, None), ('157a66d1-5ace-4b08-9acc-b0d8f3b37e43', None, None, None, None, None), ('59a1c4b3-1c8c-490d-a38a-10ccbd751e63', '10.2.2.100', None, None, None, None), ('59a1c4b3-1c8c-490d-a38a-10ccbd751e63', '10.2.2.200', None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting quotas for project 76e3715d8166472e843d6a046fc819c6. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting quotas for user 80a5b85d5cdf4f8c9fb662c6e04b74fb and project 76e3715d8166472e843d6a046fc819c6. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:18:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='61b0d03a-6007-4a40-858a-33490851ad91',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='51ffdcef-a58a-4101-a967-2a66ec25ad93',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edecdce9-a757-4671-8c6f-72b9d5048db1',volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:18:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.908752 Nov 21 14:18:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 32/91] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 21 14:18:39 2023] POST /compute/v2.1/servers => generated 403 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:42 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-14e162e8-5bea-408d-92e9-49b2f86726e0 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 200 len: 1276 microversion: 2.42 time: 0.074128 Nov 21 14:18:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 29/92] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:18:42 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 1276 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=20 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Creating event network-changed:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039007 Nov 21 14:18:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:48 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9144e297f5b43a181844d967adcebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7c11f81daa43449a6e96e3a20aa06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9b1e72e8-4030-4715-b5ae-29da816f1a68 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a" status: 200 len: 1524 microversion: 2.1 time: 0.213143 Nov 21 14:18:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:48 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a => generated 1524 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "2da6bd78-a4c0-4728-81e0-853c89c882fe"}, {"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "3bff0e3f-5977-4912-8998-ee250fc4ab87"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Creating event network-changed:2da6bd78-a4c0-4728-81e0-853c89c882fe for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Creating event network-changed:3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029743 Nov 21 14:18:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 30/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:49 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Creating event network-changed:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036951 Nov 21 14:18:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 34/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:50 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9642feeb69a74dec89b9123a2afb4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff93a19129c54087a14dde51cdd7b4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d5beb417-ff30-4880-adae-b2e848b70b2a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 200 len: 1548 microversion: 2.1 time: 0.243552 Nov 21 14:18:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 33/97] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:50 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 1548 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Creating event network-changed:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034818 Nov 21 14:18:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 31/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}, {"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Creating event network-changed:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Creating event network-changed:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:18:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040303 Nov 21 14:18:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 35/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:18:52 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:54 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ff0e0266134eb7abca050cf13030aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462575fd893488d8e31ba67b58a1879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-eb345e30-71be-4aa6-a5ae-7978e2362958 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" status: 200 len: 1551 microversion: 2.1 time: 0.452804 Nov 21 14:18:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:18:53 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 => generated 1551 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:54 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:18:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-58f05358-2ab0-451a-88f0-0a36a28ab45a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 200 len: 1627 microversion: 2.49 time: 0.252924 Nov 21 14:18:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 32/101] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:18:54 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 1627 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Creating event network-vif-plugged:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039872 Nov 21 14:19:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "2da6bd78-a4c0-4728-81e0-853c89c882fe"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Creating event network-vif-plugged:2da6bd78-a4c0-4728-81e0-853c89c882fe for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042248 Nov 21 14:19:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "3bff0e3f-5977-4912-8998-ee250fc4ab87"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Creating event network-vif-plugged:3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050943 Nov 21 14:19:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 33/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Creating event network-vif-plugged:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.042660 Nov 21 14:19:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 37/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:15 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "2da6bd78-a4c0-4728-81e0-853c89c882fe"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Creating event network-vif-plugged:2da6bd78-a4c0-4728-81e0-853c89c882fe for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Nov 21 14:19:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "3bff0e3f-5977-4912-8998-ee250fc4ab87"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Creating event network-vif-plugged:3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Creating event network-vif-plugged:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Creating event network-vif-plugged:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034247 Nov 21 14:19:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 34/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Creating event network-vif-plugged:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:19:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028438 Nov 21 14:19:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 38/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07d58ba8-3770-4f84-9c2c-5573f24f3979"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559073 Nov 21 14:19:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 37/109] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:19 2023] POST /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1156448244", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "a9ab1c2c-271a-4606-b53d-a309e4992de9"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] validate_networks() for [('a9ab1c2c-271a-4606-b53d-a309e4992de9', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting quotas for project 8612dc478d4a40babe74b1fbf45eac93. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting quotas for user ec7d58eda515420f8b815338d2efd377 and project 8612dc478d4a40babe74b1fbf45eac93. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:19:21 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:19:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.565761 Nov 21 14:19:21 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 35/110] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:19:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:19:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a540be3d-7233-4438-a284-503bbe26bdfa tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:21 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a540be3d-7233-4438-a284-503bbe26bdfa tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:21 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-a540be3d-7233-4438-a284-503bbe26bdfa tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a540be3d-7233-4438-a284-503bbe26bdfa tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 200 len: 1209 microversion: 2.1 time: 0.071830 Nov 21 14:19:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 39/111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:21 2023] GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 1209 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Creating event network-changed:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:19:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037310 Nov 21 14:19:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:19:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "name": "network-vif-plugged", "status": "completed", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Creating event network-vif-plugged:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:19:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032300 Nov 21 14:19:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "name": "network-vif-plugged", "status": "completed", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Creating event network-vif-plugged:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:19:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037185 Nov 21 14:19:29 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 40/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-017b81ef-934e-4e97-99ec-5028413c99fd tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.173808 Nov 21 14:19:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:29 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-interface => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c39d2c89-ce77-412f-8d16-0f06e55c414e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/ips" status: 200 len: 107 microversion: 2.1 time: 0.088760 Nov 21 14:19:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 37/116] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:19:31 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/ips => generated 107 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f5e41206-128a-4259-8b06-7340ad0c19ec tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.194448 Nov 21 14:19:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 41/117] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:31 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Creating event network-changed:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:19:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056819 Nov 21 14:19:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-95ee8f17-9c0b-41a9-b2e2-529eaa516839 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.195213 Nov 21 14:19:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 38/119] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:31 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-interface => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c61af748-7a31-441a-84eb-61b942667289 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 200 len: 2822 microversion: 2.42 time: 1.061819 Nov 21 14:19:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 42/120] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:19:32 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 2822 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Creating event network-changed:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:19:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Nov 21 14:19:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Creating event network-changed:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:19:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035845 Nov 21 14:19:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 43/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8aa28d50-2a56-4b17-b7a4-54a7c4a67ae1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/ips" status: 200 len: 104 microversion: 2.1 time: 0.053677 Nov 21 14:19:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 40/123] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:19:33 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/ips => generated 104 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42e5cac6-874f-4823-8631-5e556909e9ce"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:33 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cc5172d6-0c99-4570-813d-a353dbec3b02 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1539 microversion: 2.1 time: 0.386795 Nov 21 14:19:33 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:33 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1539 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673922 Nov 21 14:19:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 44/125] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:33 2023] POST /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:34 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-afd701a5-6d9a-4ba5-a063-c3918f03df60 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1539 microversion: 2.1 time: 0.572753 Nov 21 14:19:34 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 41/126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:33 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1539 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:35 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:19:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 204 len: 0 microversion: 2.1 time: 0.205856 Nov 21 14:19:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:19:35 2023] DELETE /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:36 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3b99a4f246eb89174a4e87e5da4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a7387e11d461088e466338a2804e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9ccd4797-533f-4b7a-858a-81ef035164d6 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 200 len: 1540 microversion: 2.1 time: 0.699334 Nov 21 14:19:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 45/128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:35 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 1540 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "name": "network-vif-unplugged", "status": "completed", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Creating event network-vif-unplugged:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:19:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058957 Nov 21 14:19:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 42/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "949666e2-574c-4f9a-bad7-2074e7b4d4b4"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375023 Nov 21 14:19:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 43/130] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:37 2023] POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:38 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "name": "network-vif-deleted", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] Creating event network-vif-deleted:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:19:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046863 Nov 21 14:19:38 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f0dc3a-93fe-4de4-b362-1a71696277bf", "name": "network-vif-plugged", "status": "completed", "tag": "932be03a-30bb-4fd3-bfed-064cb3a73698"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Creating event network-vif-plugged:932be03a-30bb-4fd3-bfed-064cb3a73698 for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf on user Nov 21 14:19:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Nov 21 14:19:38 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:46 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Going to try to stop instance {{(pid=64454) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 21 14:19:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action" status: 202 len: 0 microversion: 2.1 time: 0.103368 Nov 21 14:19:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 44/133] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:19:46 2023] POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9803f12b-5dd0-4ee3-b1e1-5670a433d408 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1707 microversion: 2.1 time: 0.628985 Nov 21 14:19:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 47/134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:46 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1707 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-unplugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Creating event network-vif-unplugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:19:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045508 Nov 21 14:19:47 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cb588245-a6fd-44cc-ad1d-e239f5f5d16d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: .version_select at 0x7f76b177db40>, body: {"keypair": {"name": "tempest-keypair-1382497572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmIiYZduC/8zjcxqC2bk1JleTD0+t/hkaazJI/k/Il/NHseBS83IvC42+J66mS/tO1amTRIYRJ04sNxY0CDyvrg3n10xHf4aXD9ylxnpteEJBrIC5hr41U2WjErWm0YhA=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:48 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-cb588245-a6fd-44cc-ad1d-e239f5f5d16d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:19:48 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-cb588245-a6fd-44cc-ad1d-e239f5f5d16d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cb588245-a6fd-44cc-ad1d-e239f5f5d16d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048879 Nov 21 14:19:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 45/136] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:19:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2f27a7c2-293e-4e1f-b211-499af2e7749d tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.132002 Nov 21 14:19:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 48/137] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:48 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-interface => generated 283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d269369c-e950-440e-bd5d-3d6279d3b4b5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Action: 'create', calling method: .version_select at 0x7f76b1809750>, body: {"keypair": {"name": "tempest-keypair-472520468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8C4Sb2Q7RENKXhjMcarLF6PRNiKCyXOcofalm/J3IWw+EcJ81ODybygv9li61aBZl5/kR1a+1vBMHpkuW9chHW1xqux61eLfsPFrgt66iLl0xFD3cu3JsPDbtgRvozmg=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:49 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-d269369c-e950-440e-bd5d-3d6279d3b4b5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting quotas for project aa5a6d1b33924d6c812036141c0edc9c. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:19:49 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-d269369c-e950-440e-bd5d-3d6279d3b4b5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting quotas for user 1fa93ca41a2949a0ae5ca758926f613a and project aa5a6d1b33924d6c812036141c0edc9c. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:19:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d269369c-e950-440e-bd5d-3d6279d3b4b5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050154 Nov 21 14:19:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 45/138] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:19:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:19:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035669 Nov 21 14:19:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Creating event network-changed:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:19:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043067 Nov 21 14:19:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 49/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2e050c2-4d60-4af8-ab76-22189c8983e3"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321117593", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87"}], "security_groups": [{"name": "tempest-securitygroup--1786630947"}], "key_name": "tempest-keypair-1382497572", "user_data": "}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346173 Nov 21 14:19:50 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 46/141] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:50 2023] POST /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:50 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] validate_networks() for [('3ee5933d-610e-4e1b-91f4-1b2cceb04f87', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:19:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4191ef70-5a65-4059-b35f-334d37944d1c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.210821 Nov 21 14:19:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 50/142] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:50 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-interface => generated 282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-69618808", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "5d9e28e2-df42-41c9-9d0e-20f8aa058456"}], "security_groups": [{"name": "tempest-securitygroup--2041671473"}], "key_name": "tempest-keypair-472520468", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:19:51 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] validate_networks() for [('5d9e28e2-df42-41c9-9d0e-20f8aa058456', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:19:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.639388 Nov 21 14:19:51 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 47/143] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:19:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:19:51 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-41e655f3-e7ad-460c-a372-8b087931e95b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:51 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-41e655f3-e7ad-460c-a372-8b087931e95b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:51 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-41e655f3-e7ad-460c-a372-8b087931e95b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:51 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-41e655f3-e7ad-460c-a372-8b087931e95b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 200 len: 1233 microversion: 2.1 time: 0.071597 Nov 21 14:19:51 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 51/144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:51 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 1233 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting quotas for project aa5a6d1b33924d6c812036141c0edc9c. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting quotas for user 1fa93ca41a2949a0ae5ca758926f613a and project aa5a6d1b33924d6c812036141c0edc9c. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:19:51 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:19:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.014998 Nov 21 14:19:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 47/145] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:19:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 21 14:19:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3d6053d0-07b3-4423-a11e-643a4a7aea00 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3d6053d0-07b3-4423-a11e-643a4a7aea00 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-3d6053d0-07b3-4423-a11e-643a4a7aea00 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3d6053d0-07b3-4423-a11e-643a4a7aea00 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 200 len: 1241 microversion: 2.1 time: 0.094242 Nov 21 14:19:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:19:52 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:19:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Creating event network-changed:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:19:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040214 Nov 21 14:19:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 52/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Creating event network-changed:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:19:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032267 Nov 21 14:19:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 48/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-632907a5-0e15-4a46-acf2-968e1d40b26c tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.168012 Nov 21 14:19:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:19:54 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Creating event network-changed:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:19:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159148 Nov 21 14:19:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 49/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-42a2d507-96ee-45fb-8d98-e3951a7fd919 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.328110 Nov 21 14:19:55 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 53/151] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:19:54 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface => generated 283 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:19:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Creating event network-changed:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:19:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047317 Nov 21 14:19:55 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 50/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Creating event network-changed:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040868 Nov 21 14:19:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.516472 Nov 21 14:19:56 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 50/154] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:55 2023] POST /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:56 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:19:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9fafb2cd-1889-4742-8820-f508921f3fe5 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 200 len: 1627 microversion: 2.49 time: 0.276143 Nov 21 14:19:56 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:19:56 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 1627 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "tag": "nic-tag"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e1d1a23-fa97-464d-88fd-6c284804dfeb"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836239 Nov 21 14:19:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 51/156] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:19:56 2023] POST /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "name": "network-vif-plugged", "status": "completed", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}, {"server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "name": "network-vif-plugged", "status": "completed", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Creating event network-vif-plugged:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:19:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Creating event network-vif-plugged:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:19:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043212 Nov 21 14:19:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:19:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "name": "network-vif-plugged", "status": "completed", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:19:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:19:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:19:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:19:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Creating event network-vif-plugged:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:19:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061498 Nov 21 14:19:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}, {"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}, {"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Creating event network-changed:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Creating event network-vif-plugged:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Creating event network-vif-plugged:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.036729 Nov 21 14:20:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.913176 Nov 21 14:20:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 55/160] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 21 14:19:56 2023] POST /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface => generated 282 bytes in 3915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94460595-2298-48c4-aff8-08cfddff270d", "tag": "volume-tag"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "name": "network-vif-plugged", "status": "completed", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Creating event network-vif-plugged:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:20:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074502 Nov 21 14:20:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 54/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:01 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:01 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:10 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:10 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=46 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:12 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f8b32ecc-9d7e-4e7b-b0bd-0d72ad40dfec tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 200 len: 1493 microversion: 2.1 time: 0.202767 Nov 21 14:20:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 56/162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:11 2023] GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 1493 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 12.866300 Nov 21 14:20:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 53/163] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 21 14:20:00 2023] POST /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments => generated 194 bytes in 12868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:20:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2a28eaf2-5a7c-42d2-912a-e025158f62aa"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/c2e050c2-4d60-4af8-ab76-22189c8983e3" status: 202 len: 0 microversion: 2.1 time: 0.622526 Nov 21 14:20:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 55/164] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 21 14:20:14 2023] PUT /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/c2e050c2-4d60-4af8-ab76-22189c8983e3 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85", "create_info": {"snapshot_id": "bb22cc46-a61e-4f78-89d9-cad1d6b27fd7", "type": "qcow2", "new_file": "new_file"}}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff78a6a6-5ef0-4832-8292-72647bc96a63(cell1) {{(pid=64453) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.205243 Nov 21 14:20:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 57/165] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 21 14:20:17 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff78a6a6-5ef0-4832-8292-72647bc96a63(cell1) {{(pid=64452) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%2255ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.071508 Nov 21 14:20:17 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 54/166] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 21 14:20:17 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%2255ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85%22%7D => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lazy-loading 'services' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:20:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments/55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85" status: 202 len: 0 microversion: 2.1 time: 0.344635 Nov 21 14:20:17 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:20:17 2023] DELETE /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments/55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-90711948-7cb5-48e0-9aa9-057e639f870b tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094060 Nov 21 14:20:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 58/168] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:17 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-844332da-1f77-4fac-a8c9-84e72a32c120 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Nov 21 14:20:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 55/169] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:18 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:18 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'services' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:20:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments/7e1d1a23-fa97-464d-88fd-6c284804dfeb" status: 202 len: 0 microversion: 2.1 time: 0.225304 Nov 21 14:20:18 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:20:18 2023] DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments/7e1d1a23-fa97-464d-88fd-6c284804dfeb => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:24 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5aa92b96-aad0-4cc3-a814-55cdf881d4e7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.253818 Nov 21 14:20:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 59/171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:24 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:25 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f99e4414-a7b0-467a-8fdd-2364e5986eac tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.251471 Nov 21 14:20:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 56/172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:24 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] HTTP exception thrown: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. Nov 21 14:20:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Returning 404 to user: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:20:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-761ae368-e8c9-4d3d-995c-d764d1e33cca tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 404 len: 111 microversion: 2.1 time: 0.030092 Nov 21 14:20:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:26 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] HTTP exception thrown: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. Nov 21 14:20:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Returning 404 to user: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:20:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-93b42065-4b38-4301-b2d1-085c83fc0cd5 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030253 Nov 21 14:20:26 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 60/174] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:26 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] HTTP exception thrown: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. Nov 21 14:20:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Returning 404 to user: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:20:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f6841799-8e19-40c4-90d3-34df1a4357fd tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 404 len: 111 microversion: 2.1 time: 0.064806 Nov 21 14:20:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 57/175] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:20:30 2023] DELETE /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] HTTP exception thrown: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. Nov 21 14:20:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Returning 404 to user: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:20:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2542adc5-8eed-492b-bf24-b27b9ceb2973 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf" status: 404 len: 111 microversion: 2.1 time: 0.026292 Nov 21 14:20:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:30 2023] GET /compute/v2.1/servers/c8f0dc3a-93fe-4de4-b362-1a71696277bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:31 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'services' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:20:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments/94460595-2298-48c4-aff8-08cfddff270d" status: 202 len: 0 microversion: 2.49 time: 0.540288 Nov 21 14:20:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 61/177] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 21 14:20:31 2023] DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments/94460595-2298-48c4-aff8-08cfddff270d => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-66ba03ba-2eeb-49df-b93f-042adf5cef77 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.404580 Nov 21 14:20:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 58/178] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:20:33 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b/os-interface => generated 1831 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 14:20:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Creating event network-changed:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048026 Nov 21 14:20:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 60/179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1de6ee8e-fd5c-4fc4-b438-fccc09d77edc tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 200 len: 2822 microversion: 2.42 time: 0.581114 Nov 21 14:20:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 62/180] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:20:35 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 2822 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ee4ebf1a-840b-4465-b12c-14592cf75489 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.135445 Nov 21 14:20:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 59/181] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:20:35 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b/os-interface => generated 1831 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9077887b-b819-4f90-9cd3-a13b6c92d573 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053636 Nov 21 14:20:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:36 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2241eec4-a160-4e6f-86be-659b13fa79ef tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051669 Nov 21 14:20:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:36 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c2e050c2-4d60-4af8-ab76-22189c8983e3"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/2a28eaf2-5a7c-42d2-912a-e025158f62aa" status: 202 len: 0 microversion: 2.1 time: 0.304464 Nov 21 14:20:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 60/184] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 21 14:20:36 2023] PUT /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/2a28eaf2-5a7c-42d2-912a-e025158f62aa => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:37 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f3db02d6-14b8-4c87-9bdf-22669c056dbe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1684 microversion: 2.1 time: 0.204344 Nov 21 14:20:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:37 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:20:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 204 len: 0 microversion: 2.42 time: 0.197768 Nov 21 14:20:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 64/186] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:20:37 2023] DELETE /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:37 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6948328c-8df5-44e3-bb30-a4310fe6f3e9 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 200 len: 2947 microversion: 2.42 time: 0.254917 Nov 21 14:20:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 61/187] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:20:37 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 2947 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:20:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Creating event network-vif-unplugged:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042404 Nov 21 14:20:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:38 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "2da6bd78-a4c0-4728-81e0-853c89c882fe"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Creating event network-vif-unplugged:2da6bd78-a4c0-4728-81e0-853c89c882fe for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "3bff0e3f-5977-4912-8998-ee250fc4ab87"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044952 Nov 21 14:20:38 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 65/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Creating event network-vif-unplugged:3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066569 Nov 21 14:20:38 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 62/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:40 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-plugged:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-unplugged:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-plugged:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-unplugged:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-plugged:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-unplugged:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Creating event network-vif-plugged:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.057462 Nov 21 14:20:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 21 14:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "3bff0e3f-5977-4912-8998-ee250fc4ab87"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-unplugged", "status": "completed", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Creating event network-vif-plugged:3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Creating event network-vif-unplugged:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Creating event network-vif-plugged:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-plugged", "status": "completed", "tag": "2da6bd78-a4c0-4728-81e0-853c89c882fe"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.051574 Nov 21 14:20:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 66/192] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Creating event network-vif-plugged:2da6bd78-a4c0-4728-81e0-853c89c882fe for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Nov 21 14:20:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 63/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f11e8a7e-e0d6-41f2-8da8-19aac7b5fbf7 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041388 Nov 21 14:20:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:41 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f8a640ba-bdb5-4a6e-965b-fc40add70db4 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054238 Nov 21 14:20:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:41 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:20:41 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dc7f4cdb-3856-411c-8e98-0c9ef74fb8b9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 200 len: 1542 microversion: 2.1 time: 0.229807 Nov 21 14:20:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:41 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 1542 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 204 len: 0 microversion: 2.1 time: 0.123066 Nov 21 14:20:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:20:41 2023] DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:42 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9642feeb69a74dec89b9123a2afb4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff93a19129c54087a14dde51cdd7b4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bff1d6e6-cde1-4b99-8e3b-e5a612b43e1b tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 200 len: 1673 microversion: 2.1 time: 0.480102 Nov 21 14:20:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:41 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 1673 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:42 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:20:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-07389d16-67fa-4af4-9b2b-a71212dbee9e tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 200 len: 1560 microversion: 2.1 time: 0.216530 Nov 21 14:20:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:20:42 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:20:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "name": "network-vif-unplugged", "status": "completed", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Creating event network-vif-unplugged:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:20:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033323 Nov 21 14:20:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "name": "network-vif-deleted", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] Creating event network-vif-deleted:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:20:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Nov 21 14:20:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 69/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed46662-03d4-4005-967f-56759e6dbe02", "name": "network-vif-plugged", "status": "completed", "tag": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-deleted", "tag": "dc19bf1d-6c50-486a-952c-3b3d067409f7"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-deleted", "tag": "33afd222-329a-46d7-81b1-f24247b83c00"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Creating event network-vif-plugged:a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance aed46662-03d4-4005-967f-56759e6dbe02 on user Nov 21 14:20:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Creating event network-vif-deleted:dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Creating event network-vif-deleted:33afd222-329a-46d7-81b1-f24247b83c00 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039902 Nov 21 14:20:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 66/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-deleted", "tag": "77f1d830-ef25-47d5-a04a-76b7596eb24d"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-deleted", "tag": "e4ad7de7-0f3a-4611-9aea-96d24957ab96"}, {"server_uuid": "8e29b0dc-380b-42d1-a43d-048de2d2e57b", "name": "network-vif-deleted", "tag": "a39dce5a-2098-4347-82f4-a79edc2b3edf"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Creating event network-vif-deleted:77f1d830-ef25-47d5-a04a-76b7596eb24d for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Creating event network-vif-deleted:e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] Creating event network-vif-deleted:a39dce5a-2098-4347-82f4-a79edc2b3edf for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b on user Nov 21 14:20:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038995 Nov 21 14:20:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6e1fed95-3450-47b1-a33c-e5700d186688 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048366 Nov 21 14:20:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 70/204] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:52 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ffbb421e-0526-46e8-b08d-95afba43d03a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050485 Nov 21 14:20:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:52 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'services' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:20:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/c2e050c2-4d60-4af8-ab76-22189c8983e3" status: 202 len: 0 microversion: 2.1 time: 0.192011 Nov 21 14:20:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:20:52 2023] DELETE /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments/c2e050c2-4d60-4af8-ab76-22189c8983e3 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ba2da273-37bf-425f-a7c7-736eb7c0658a tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042308 Nov 21 14:20:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 71/207] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:20:52 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface/72906f62-8c9d-4af7-9a8d-06fa07fe7950" status: 202 len: 0 microversion: 2.49 time: 0.083743 Nov 21 14:20:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 68/208] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 21 14:20:54 2023] DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-interface/72906f62-8c9d-4af7-9a8d-06fa07fe7950 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f50f70d0-5c22-4f1e-9b16-99de2c5a6d41 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20" status: 200 len: 474 microversion: 2.49 time: 0.274431 Nov 21 14:20:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 70/209] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 21 14:20:54 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20 => generated 474 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 14:20:55 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-unplugged", "status": "completed", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Creating event network-vif-unplugged:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:20:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054393 Nov 21 14:20:55 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 72/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:20:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:20:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:20:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:20:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:20:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Creating event network-vif-plugged:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:20:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 Nov 21 14:20:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a8f4328d-f7ce-4495-ac7f-8d754a7bd02f tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Action: 'create', calling method: .version_select at 0x7f76b1510ca0>, body: {"keypair": {"name": "tempest-keypair-1738218210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:03 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a8f4328d-f7ce-4495-ac7f-8d754a7bd02f tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting quotas for project 0b45a2561f064eedb95133a91c79585e. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:21:03 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a8f4328d-f7ce-4495-ac7f-8d754a7bd02f tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting quotas for user 1448e4787c2c4c0bb6c3e1f7241246e7 and project 0b45a2561f064eedb95133a91c79585e. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:21:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a8f4328d-f7ce-4495-ac7f-8d754a7bd02f tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.045683 Nov 21 14:21:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 71/212] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:21:03 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:21:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1960452780", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0"}, {"port": "29164a1e-6f52-4e02-8bf9-af322c771dab", "tag": "port-1"}, {"port": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "tag": "port-2"}, {"uuid": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "tag": "net-1"}, {"uuid": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc"}, {"uuid": "35f76db6-4bab-4690-87a0-25042e3aea04", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "35f76db6-4bab-4690-87a0-25042e3aea04", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "55f6cd42-6971-4118-bd73-a6b5bd162c87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e12c01ce-49fb-4570-88d1-9d57881b22e5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e8c51fdd-7afa-44f1-8481-cd70f9fdc085", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1334241299"}], "key_name": "tempest-keypair-1738218210", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:04 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] validate_networks() for [('f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0', None, None, None, None, None), (None, None, '29164a1e-6f52-4e02-8bf9-af322c771dab', None, None, None), (None, None, 'f3d78a1a-34cd-4673-ac41-572a523c57c0', None, None, None), ('addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc', None, None, None, None, None), ('addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc', None, None, None, None, None), ('35f76db6-4bab-4690-87a0-25042e3aea04', '10.2.2.100', None, None, None, None), ('35f76db6-4bab-4690-87a0-25042e3aea04', '10.2.2.200', None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:21:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting quotas for project 0b45a2561f064eedb95133a91c79585e. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting quotas for user 1448e4787c2c4c0bb6c3e1f7241246e7 and project 0b45a2561f064eedb95133a91c79585e. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:21:06 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='55f6cd42-6971-4118-bd73-a6b5bd162c87',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e12c01ce-49fb-4570-88d1-9d57881b22e5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8c51fdd-7afa-44f1-8481-cd70f9fdc085',volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:21:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.161558 Nov 21 14:21:06 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 73/213] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 21 14:21:04 2023] POST /compute/v2.1/servers => generated 404 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:21:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:06 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:06 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:06 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-edd86846-3fc9-41cb-b7a1-af9434f195e8 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 200 len: 1278 microversion: 2.32 time: 0.065733 Nov 21 14:21:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 70/214] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:21:06 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 1278 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ca8dd641-65ae-4ff7-9010-411aa127da46 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046802 Nov 21 14:21:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:21:08 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:21:11 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" status: 204 len: 0 microversion: 2.1 time: 0.159211 Nov 21 14:21:11 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:21:11 2023] DELETE /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=37 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:11 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ff0e0266134eb7abca050cf13030aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462575fd893488d8e31ba67b58a1879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ba704451-68c0-4e25-849a-3948eb937a50 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" status: 200 len: 1676 microversion: 2.1 time: 0.265310 Nov 21 14:21:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:11 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 => generated 1676 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "name": "network-vif-unplugged", "status": "completed", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Creating event network-vif-unplugged:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:21:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035506 Nov 21 14:21:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:21:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 204 len: 0 microversion: 2.1 time: 0.134790 Nov 21 14:21:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 75/219] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:21:12 2023] DELETE /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Creating event network-changed:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040600 Nov 21 14:21:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:21:12 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f3d1a83e-f3fb-4bb2-ab3c-0733eb40f862 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 200 len: 1499 microversion: 2.1 time: 0.427490 Nov 21 14:21:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 72/221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:12 2023] GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 1499 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:14 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "name": "network-vif-plugged", "status": "completed", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}, {"server_uuid": "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2", "name": "network-vif-deleted", "tag": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa"}, {"server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "name": "network-vif-deleted", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Creating event network-vif-plugged:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:21:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Creating event network-vif-deleted:a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 on user Nov 21 14:21:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Creating event network-vif-deleted:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:21:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.236383 Nov 21 14:21:14 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 76/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "name": "network-vif-unplugged", "status": "completed", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}, {"server_uuid": "51a5901c-6c03-4b4d-8737-8780e7224fcf", "name": "network-vif-plugged", "status": "completed", "tag": "77c09ab5-9563-4a3c-b841-2919c6b2db58"}, {"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "29164a1e-6f52-4e02-8bf9-af322c771dab"}, {"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "f3d78a1a-34cd-4673-ac41-572a523c57c0"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Creating event network-vif-unplugged:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:21:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Creating event network-vif-plugged:77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf on user Nov 21 14:21:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Creating event network-changed:29164a1e-6f52-4e02-8bf9-af322c771dab for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Creating event network-changed:f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 690 microversion: 2.1 time: 0.045229 Nov 21 14:21:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 690 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Creating event network-changed:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Creating event network-changed:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033545 Nov 21 14:21:16 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 73/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:16 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-deleted", "tag": "72906f62-8c9d-4af7-9a8d-06fa07fe7950"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] Creating event network-vif-deleted:72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:21:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036850 Nov 21 14:21:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Creating event network-changed:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Creating event network-changed:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034632 Nov 21 14:21:18 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0281627a-7d3b-4061-99cc-d78f2459d7c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: .version_select at 0x7f76b1509120>, body: {"keypair": {"name": "tempest-keypair-1536111499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:25 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-0281627a-7d3b-4061-99cc-d78f2459d7c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:21:25 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-0281627a-7d3b-4061-99cc-d78f2459d7c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:21:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0281627a-7d3b-4061-99cc-d78f2459d7c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056077 Nov 21 14:21:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 74/227] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:21:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1099597183", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "af07711f-e1bf-40bf-9cdc-f912efa55fcd"}], "security_groups": [{"name": "tempest-securitygroup--1784109540"}], "key_name": "tempest-keypair-1536111499", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] validate_networks() for [('af07711f-e1bf-40bf-9cdc-f912efa55fcd', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:21:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:21:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.661075 Nov 21 14:21:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 78/228] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:21:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:21:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d9e19e87-4c14-432f-b000-0d339e91b244 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d9e19e87-4c14-432f-b000-0d339e91b244 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:28 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-d9e19e87-4c14-432f-b000-0d339e91b244 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d9e19e87-4c14-432f-b000-0d339e91b244 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1234 microversion: 2.1 time: 0.077368 Nov 21 14:21:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 77/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:28 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HTTP exception thrown: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. Nov 21 14:21:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Returning 404 to user: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-556692f6-bcee-4cdf-9337-914bd34f5a5b tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 404 len: 111 microversion: 2.42 time: 0.029475 Nov 21 14:21:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 75/230] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:21:28 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:21:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e57fc487-a3c5-4d47-ae2b-f067d91efa1d tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '.version_select at 0x7f76b152e290>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e57fc487-a3c5-4d47-ae2b-f067d91efa1d tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419935771" status: 204 len: 0 microversion: 2.42 time: 0.029268 Nov 21 14:21:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 79/231] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 21 14:21:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419935771 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:21:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:30 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Creating event network-changed:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:21:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030647 Nov 21 14:21:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 78/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HTTP exception thrown: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. Nov 21 14:21:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Returning 404 to user: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-078ccbe7-d594-4fb8-ae21-def3b573b7df tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 404 len: 111 microversion: 2.42 time: 0.029307 Nov 21 14:21:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 76/233] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:21:31 2023] DELETE /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HTTP exception thrown: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. Nov 21 14:21:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Returning 404 to user: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-32785b97-420b-4525-8fab-61686d89b516 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b" status: 404 len: 111 microversion: 2.42 time: 0.030697 Nov 21 14:21:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 80/234] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:21:31 2023] GET /compute/v2.1/servers/8e29b0dc-380b-42d1-a43d-048de2d2e57b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] HTTP exception thrown: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. Nov 21 14:21:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Returning 404 to user: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-692cb876-b2ba-4b1f-ab0c-011aa23b6e4a tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 404 len: 111 microversion: 2.1 time: 0.026576 Nov 21 14:21:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:32 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:21:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-56d29d7f-513c-4aa1-aa02-4531c1331022 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '.version_select at 0x7f76b1629bd0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-56d29d7f-513c-4aa1-aa02-4531c1331022 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090548767" status: 202 len: 0 microversion: 2.1 time: 0.022964 Nov 21 14:21:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 77/236] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:21:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090548767 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:21:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:21:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Nov 21 14:21:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 81/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:21:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Nov 21 14:21:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "29164a1e-6f52-4e02-8bf9-af322c771dab"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Creating event network-vif-plugged:29164a1e-6f52-4e02-8bf9-af322c771dab for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052294 Nov 21 14:21:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 78/239] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "f3d78a1a-34cd-4673-ac41-572a523c57c0"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "f3d78a1a-34cd-4673-ac41-572a523c57c0"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Creating event network-vif-plugged:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Creating event network-vif-plugged:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Creating event network-vif-plugged:f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Creating event network-vif-plugged:f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069867 Nov 21 14:21:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:36 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Creating event network-vif-plugged:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038224 Nov 21 14:21:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Going to try to start instance {{(pid=64452) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 21 14:21:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action" status: 202 len: 0 microversion: 2.1 time: 0.160868 Nov 21 14:21:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 79/242] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:21:37 2023] POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] HTTP exception thrown: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. Nov 21 14:21:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Returning 404 to user: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-777b1f9b-881e-4c0f-bd9a-7e1f3eef20a0 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 404 len: 111 microversion: 2.1 time: 0.061028 Nov 21 14:21:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 83/243] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:21:37 2023] DELETE /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] HTTP exception thrown: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. Nov 21 14:21:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Returning 404 to user: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-82b4b4aa-76d5-47e2-8b94-7b014dff4f3f tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02" status: 404 len: 111 microversion: 2.1 time: 0.041705 Nov 21 14:21:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:37 2023] GET /compute/v2.1/servers/aed46662-03d4-4005-967f-56759e6dbe02 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:21:38 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "29164a1e-6f52-4e02-8bf9-af322c771dab"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:29164a1e-6f52-4e02-8bf9-af322c771dab for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Creating event network-vif-plugged:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.077068 Nov 21 14:21:38 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 84/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:38 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-79b84906-591a-47dc-9ab4-90aa3840487d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1693 microversion: 2.1 time: 0.499296 Nov 21 14:21:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 82/246] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:37 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1693 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:39 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:39 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Creating event network-vif-plugged:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:39 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063788 Nov 21 14:21:39 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 81/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Creating event network-vif-plugged:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:21:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039649 Nov 21 14:21:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 85/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c2efe40f-60a9-4a04-8fa3-81593121213f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.388233 Nov 21 14:21:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:21:41 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/os-interface => generated 282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-fab86057-18e7-4971-beba-3087e7401bb2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084013 Nov 21 14:21:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 86/250] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:21:42 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:21:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a" status: 204 len: 0 microversion: 2.1 time: 0.135977 Nov 21 14:21:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 84/251] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:21:42 2023] DELETE /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ac3576c9-14d5-4223-8b77-644eff7deb3b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.478182 Nov 21 14:21:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 82/252] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:21:42 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-interface => generated 282 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "name": "network-vif-unplugged", "status": "completed", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Creating event network-vif-unplugged:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:21:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039140 Nov 21 14:21:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9144e297f5b43a181844d967adcebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7c11f81daa43449a6e96e3a20aa06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-06afbfea-5479-46b1-94af-34dbb8256764 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a" status: 200 len: 1649 microversion: 2.1 time: 0.600476 Nov 21 14:21:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 87/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:42 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a => generated 1649 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Creating event network-changed:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:21:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051050 Nov 21 14:21:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 83/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e9b14a39-f695-44bc-8578-b19b036841ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/ips" status: 200 len: 107 microversion: 2.1 time: 0.088482 Nov 21 14:21:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:21:43 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/ips => generated 107 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42e5cac6-874f-4823-8631-5e556909e9ce"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Creating event network-changed:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:21:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047905 Nov 21 14:21:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 84/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Invalid volume: volume 42e5cac6-874f-4823-8631-5e556909e9ce is already attached to instances: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee Nov 21 14:21:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 400 to user: Invalid volume: volume 42e5cac6-874f-4823-8631-5e556909e9ce is already attached to instances: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:21:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1dd526fc-3772-4ec5-97f8-8b14a9b2174b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.222811 Nov 21 14:21:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:21:43 2023] POST /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12/os-volume_attachments => generated 174 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 204 len: 0 microversion: 2.1 time: 0.132316 Nov 21 14:21:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:21:43 2023] DELETE /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6a71a595-af09-4fc0-afe7-318b891852ec tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 200 len: 1560 microversion: 2.1 time: 0.564852 Nov 21 14:21:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 85/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:44 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 1560 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching by: {'deleted': False, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c'} {{(pid=64454) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:44 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:44 user devstack@n-api.service[64454]: DEBUG nova.compute.multi_cell_list [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64454) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 21 14:21:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-846902f4-0800-427e-9c1c-4f9d5f7bc31f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 200 len: 1548 microversion: 2.1 time: 0.674763 Nov 21 14:21:44 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 89/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:21:44 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 1548 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-20395ebe-1f90-4ba3-ba73-a2c2770c6579 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 349 microversion: 2.1 time: 0.178959 Nov 21 14:21:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 21 14:21:44 2023] GET /compute/v2.1/servers => generated 349 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ba22751-58d1-456d-be4d-ddcb85ff1a4f"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-954d5d92-2736-4db2-87dd-f7107dce71ef tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20" status: 200 len: 503 microversion: 2.49 time: 0.237121 Nov 21 14:21:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 86/263] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 21 14:21:45 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20 => generated 503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "name": "network-vif-plugged", "status": "completed", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Creating event network-vif-plugged:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:21:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060803 Nov 21 14:21:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 87/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3cb3f607-4d68-439c-a582-f05632a44dc9 tempest-TaggedAttachmentsTest-1672193667 tempest-TaggedAttachmentsTest-1672193667-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20" status: 200 len: 503 microversion: 2.49 time: 0.160378 Nov 21 14:21:45 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 89/265] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 21 14:21:45 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-instance-actions/req-bb41b591-8bdc-43f3-8f27-100d6341ab20 => generated 503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "name": "network-vif-unplugged", "status": "completed", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Creating event network-vif-unplugged:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:21:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075184 Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-114dddde-b663-42e7-bca2-984b69c415ca tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.126236 Nov 21 14:21:45 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 90/267] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 21 14:21:45 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494438 Nov 21 14:21:45 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 90/268] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:21:45 2023] POST /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:45 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:21:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 204 len: 0 microversion: 2.49 time: 0.233808 Nov 21 14:21:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 89/269] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:21:45 2023] DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:46 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c74182b7-2aa0-4c56-9fcd-fe6255108e3a tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 200 len: 1752 microversion: 2.49 time: 0.390136 Nov 21 14:21:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 91/270] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:21:46 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 1752 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:21:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-unplugged", "status": "completed", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Creating event network-vif-unplugged:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:21:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037734 Nov 21 14:21:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 91/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "name": "network-vif-plugged", "status": "completed", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}, {"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}, {"server_uuid": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "name": "network-vif-deleted", "tag": "090c076d-0081-4d00-9cb0-a8e9967622ad"}, {"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Creating event network-vif-plugged:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:21:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:21:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Creating event network-vif-deleted:090c076d-0081-4d00-9cb0-a8e9967622ad for instance b33785fd-01ad-4d08-9b66-f664b7440b1a on user Nov 21 14:21:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:21:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.057852 Nov 21 14:21:47 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 90/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898bb3eb-39ce-4476-84b9-eb258eccbd12", "name": "network-vif-deleted", "tag": "9b592c77-100d-4bcd-8922-ca8fadfb012a"}, {"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-plugged", "status": "completed", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Creating event network-vif-deleted:9b592c77-100d-4bcd-8922-ca8fadfb012a for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 on user Nov 21 14:21:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Creating event network-vif-plugged:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:21:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050194 Nov 21 14:21:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deaafad-f14d-4525-acaf-1ff5986f3db0", "name": "network-vif-deleted", "tag": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:21:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] Creating event network-vif-deleted:eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 on user Nov 21 14:21:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067250 Nov 21 14:21:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:57 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:57 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:58 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:21:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b3b3e177-a054-42c7-8ce3-3e112e0b6398 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 200 len: 2820 microversion: 2.32 time: 0.807309 Nov 21 14:21:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 91/275] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:21:57 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 2820 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG nova.compute.api [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-75141bcb-fc83-4c0b-815e-20a1adb440cb req-e2bb27ac-a6d8-401e-b6f0-fb98f2bd1ae4 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.576706 Nov 21 14:21:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 93/276] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:21:57 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:21:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:21:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7abd5d93-2383-46f0-af4f-01db050dd5b7 req-507963a0-19a7-4cd2-8f1b-584d850ba2ff tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.182407 Nov 21 14:21:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 93/277] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:21:58 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-2f4a8ced-80dc-4b38-8870-5f9b1576384b req-69d15ce8-dc08-4f79-8ad8-2ff279208f7b tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.394114 Nov 21 14:22:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 92/278] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:21:59 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7849a07f-90bd-4f5c-a516-b60b57675895 req-0685afd8-2d40-4593-9d5a-7880b2dfb146 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.174560 Nov 21 14:22:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 94/279] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:22:00 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7fcd71c6-8a95-413c-b2d6-c1141aaa5e73 req-b6b7adcb-1fd2-4950-ae9a-c485d3b6ba8b tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.154105 Nov 21 14:22:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 94/280] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:22:01 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-fdbed85b-2b81-44bc-89f6-39d5d4c191cb req-77439bfc-9181-4cd5-a51e-8d7d3ce1b528 tempest-TestServerVolumeAttachmentScenario-517660991 tempest-TestServerVolumeAttachmentScenario-517660991-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 200 len: 302 microversion: 2.89 time: 0.101082 Nov 21 14:22:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 93/281] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:22:01 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3e31898-7f58-497f-b331-c17c694f2e54"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] HTTP exception thrown: Instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 could not be found. Nov 21 14:22:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Returning 404 to user: Instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-61d5c45e-7a55-493a-9dea-229fd63d1052 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" status: 404 len: 111 microversion: 2.1 time: 0.038017 Nov 21 14:22:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:01 2023] GET /compute/v2.1/servers/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5c2f06de-f6a4-4926-8fae-68a781cf012f tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Calling method '.version_select at 0x7f76b145c700>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5c2f06de-f6a4-4926-8fae-68a781cf012f tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973639123" status: 202 len: 0 microversion: 2.1 time: 0.024170 Nov 21 14:22:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 94/283] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:22:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973639123 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:22:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384769 Nov 21 14:22:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:22:01 2023] POST /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] HTTP exception thrown: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. Nov 21 14:22:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 404 to user: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-935a4c69-fe57-43e5-ac7f-6375e28da939 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 404 len: 111 microversion: 2.1 time: 0.030029 Nov 21 14:22:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:02 2023] GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:03 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-512f606c-cfe1-4ba9-a5b0-43da23db85cb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1492 microversion: 2.1 time: 0.206876 Nov 21 14:22:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 95/286] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:02 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1492 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:22:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-53f23f7c-dfdf-4718-ae65-393f219adab3 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Action: 'create', calling method: .version_select at 0x7f76b14d5e10>, body: {"keypair": {"name": "tempest-keypair-829674788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIgtT9MPdGsRerkoAmYBJprp9EZkPrFi/Tb9V24DN84MmkyPsD+E5nrKgRf83VTJ0tWnfZvruXA2QsHcBiuOnJInoeUVnqKKOtMOWNdnF/4teCiXe3ULO+8JRSuIQOh6A=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:07 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-53f23f7c-dfdf-4718-ae65-393f219adab3 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for project a26cdaa13ed94137bcb577358a2054dc. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:07 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-53f23f7c-dfdf-4718-ae65-393f219adab3 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for user 85844a0bfabd4095b647684ad7a1003a and project a26cdaa13ed94137bcb577358a2054dc. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-53f23f7c-dfdf-4718-ae65-393f219adab3 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238590 Nov 21 14:22:07 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 96/287] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:22:07 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-926413379", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "339e70be-6083-486f-b6a2-097ee63ca3e4"}], "security_groups": [{"name": "tempest-securitygroup--1026211567"}], "key_name": "tempest-keypair-829674788", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] validate_networks() for [('339e70be-6083-486f-b6a2-097ee63ca3e4', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:22:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1151244324", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "25c54848-a31e-4a8b-acba-2675da8ba572"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:09 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] validate_networks() for [('25c54848-a31e-4a8b-acba-2675da8ba572', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for project a26cdaa13ed94137bcb577358a2054dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for user 85844a0bfabd4095b647684ad7a1003a and project a26cdaa13ed94137bcb577358a2054dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:22:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:22:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.630464 Nov 21 14:22:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 97/288] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:22:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:22:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c7494417-ac9a-4f88-aa30-2432a8b972c4 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:09 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c7494417-ac9a-4f88-aa30-2432a8b972c4 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:09 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c7494417-ac9a-4f88-aa30-2432a8b972c4 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c7494417-ac9a-4f88-aa30-2432a8b972c4 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b" status: 200 len: 1232 microversion: 2.1 time: 0.086402 Nov 21 14:22:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:09 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for user 7635b3029cf14950a1978282d06bc8f3 and project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:22:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:22:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.911334 Nov 21 14:22:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 96/290] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:22:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:22:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-10544206-7dfc-47b0-a7cd-0f63a69c5bb7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 200 len: 1395 microversion: 2.87 time: 0.125169 Nov 21 14:22:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 98/291] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:22:10 2023] GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 1395 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:12 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'services' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:22:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/a3e31898-7f58-497f-b331-c17c694f2e54" status: 202 len: 0 microversion: 2.1 time: 0.184222 Nov 21 14:22:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:22:12 2023] DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/a3e31898-7f58-497f-b331-c17c694f2e54 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-22435205-7aa5-4d52-87a4-88fb6b74bb07 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069259 Nov 21 14:22:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:22:12 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Creating event network-changed:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:22:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058814 Nov 21 14:22:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Creating event network-changed:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:22:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033687 Nov 21 14:22:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 99/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "name": "network-vif-plugged", "status": "completed", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Creating event network-vif-plugged:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:22:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034283 Nov 21 14:22:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "name": "network-vif-plugged", "status": "completed", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Creating event network-vif-plugged:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:22:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037179 Nov 21 14:22:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 100/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "name": "network-vif-plugged", "status": "completed", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Creating event network-vif-plugged:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:22:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038472 Nov 21 14:22:17 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 100/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "name": "network-vif-plugged", "status": "completed", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:18 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Creating event network-vif-plugged:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:22:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bbaa3973-2c15-4f3e-ade0-3ac1ceda873b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1543 microversion: 2.1 time: 0.226315 Nov 21 14:22:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:18 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1543 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:22:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042806 Nov 21 14:22:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=120,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:28 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ede7d940-6e9a-4171-865e-7265af07f126 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1697 microversion: 2.1 time: 0.438725 Nov 21 14:22:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:28 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1697 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=5 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=103,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] HTTP exception thrown: Instance b33785fd-01ad-4d08-9b66-f664b7440b1a could not be found. Nov 21 14:22:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Returning 404 to user: Instance b33785fd-01ad-4d08-9b66-f664b7440b1a could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-47a852b9-ee91-4b87-be39-2449f835c026 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a" status: 404 len: 111 microversion: 2.1 time: 0.035484 Nov 21 14:22:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 100/302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:33 2023] GET /compute/v2.1/servers/b33785fd-01ad-4d08-9b66-f664b7440b1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:22:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7b610d87-ca0b-4767-93fb-100a57e90ff5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Calling method '.version_select at 0x7f76b1495a20>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7b610d87-ca0b-4767-93fb-100a57e90ff5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966473581" status: 202 len: 0 microversion: 2.1 time: 0.036163 Nov 21 14:22:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:22:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966473581 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. Nov 21 14:22:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4b5b0679-e966-4f71-aba1-40756f1601d6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 404 len: 111 microversion: 2.1 time: 0.227704 Nov 21 14:22:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:34 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:22:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3ee332b6-07ee-4cd8-9055-d5804c660c3a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '.version_select at 0x7f76b131c430>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3ee332b6-07ee-4cd8-9055-d5804c660c3a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382497572" status: 202 len: 0 microversion: 2.1 time: 0.022289 Nov 21 14:22:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:22:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382497572 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:35 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'services' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:22:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments/42e5cac6-874f-4823-8631-5e556909e9ce" status: 202 len: 0 microversion: 2.1 time: 0.257170 Nov 21 14:22:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:22:35 2023] DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments/42e5cac6-874f-4823-8631-5e556909e9ce => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-89e3f693-7f4d-46bb-b057-2d524721e596 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049572 Nov 21 14:22:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:22:36 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] HTTP exception thrown: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. Nov 21 14:22:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Returning 404 to user: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-08f84d54-c68f-41fe-b9f4-8d4509e793af tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 404 len: 111 microversion: 2.49 time: 0.045799 Nov 21 14:22:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 102/308] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:22:36 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:22:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d86d5dbd-8b0f-4c07-a43d-54edb63bb628 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '.version_select at 0x7f76b1494430>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d86d5dbd-8b0f-4c07-a43d-54edb63bb628 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733819265" status: 204 len: 0 microversion: 2.49 time: 0.048426 Nov 21 14:22:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 21 14:22:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733819265 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] HTTP exception thrown: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. Nov 21 14:22:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Returning 404 to user: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d112a2db-a284-48a6-beff-6d4732dbcdcf tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 404 len: 111 microversion: 2.49 time: 0.043731 Nov 21 14:22:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 104/310] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:22:38 2023] DELETE /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] HTTP exception thrown: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. Nov 21 14:22:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Returning 404 to user: Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:22:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-56caa484-e384-4f58-be63-0e36b75ad035 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0" status: 404 len: 111 microversion: 2.49 time: 0.033839 Nov 21 14:22:38 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:22:38 2023] GET /compute/v2.1/servers/4deaafad-f14d-4525-acaf-1ff5986f3db0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:22:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-38367f1f-3a4e-4bea-bf66-3a9079bae8ea tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Action: 'create', calling method: .version_select at 0x7f76b131da20>, body: {"keypair": {"name": "tempest-keypair-1155942104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:54 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-38367f1f-3a4e-4bea-bf66-3a9079bae8ea tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for project ccf822369a824ed3912173b2f27fddbf. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:54 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-38367f1f-3a4e-4bea-bf66-3a9079bae8ea tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for user a19fbffc4df04656950aa2bb1a2bb48a and project ccf822369a824ed3912173b2f27fddbf. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-38367f1f-3a4e-4bea-bf66-3a9079bae8ea tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181970 Nov 21 14:22:54 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 105/312] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:22:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-1299552937", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "c79fd2b1-e52c-4763-9cca-3335eec59112"}], "security_groups": [{"name": "tempest-securitygroup--564441559"}], "key_name": "tempest-keypair-1155942104", "user_data": "}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:56 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:56 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=16 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:56 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] validate_networks() for [('c79fd2b1-e52c-4763-9cca-3335eec59112', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for project ccf822369a824ed3912173b2f27fddbf. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for user a19fbffc4df04656950aa2bb1a2bb48a and project ccf822369a824ed3912173b2f27fddbf. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:22:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:22:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.083364 Nov 21 14:22:57 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 105/313] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:22:56 2023] POST /compute/v2.1/servers => generated 406 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:22:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0dae98f9-317e-430c-9775-3db347d2cd76 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:57 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0dae98f9-317e-430c-9775-3db347d2cd76 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:22:57 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-0dae98f9-317e-430c-9775-3db347d2cd76 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:22:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0dae98f9-317e-430c-9775-3db347d2cd76 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1233 microversion: 2.1 time: 0.206079 Nov 21 14:22:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:57 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1233 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8b606a18-0d81-4b88-8bb6-0692663ebe1e tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Action: 'create', calling method: .version_select at 0x7f76b1510a60>, body: {"keypair": {"name": "tempest-keypair-993669652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:58 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8b606a18-0d81-4b88-8bb6-0692663ebe1e tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for project a906ab977ca047e8aacb9c696f166a20. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:22:58 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8b606a18-0d81-4b88-8bb6-0692663ebe1e tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for user ff48456740444cf8aee032129cc9f087 and project a906ab977ca047e8aacb9c696f166a20. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:22:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8b606a18-0d81-4b88-8bb6-0692663ebe1e tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.93 time: 0.170135 Nov 21 14:22:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 106/315] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:22:58 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:22:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-54c793e0-28ca-4b95-9419-8e3d2e28c39a tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.422765 Nov 21 14:22:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 106/316] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:22:58 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95/os-interface => generated 1828 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:22:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:22:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Creating event network-changed:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:22:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098660 Nov 21 14:22:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:22:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b95dccfd-1d8d-466e-a81a-a47399f18f7d tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 200 len: 2820 microversion: 2.32 time: 0.409929 Nov 21 14:23:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:22:59 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 2820 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:00 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-179a3e2f-18ec-4280-b3b6-777502f966da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b" status: 200 len: 1541 microversion: 2.1 time: 0.631989 Nov 21 14:23:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:22:59 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b => generated 1541 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3c6ee685-d344-4d44-b3a9-1d7f5ed49ddc tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.488012 Nov 21 14:23:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 106/320] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:23:00 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95/os-interface => generated 1828 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:23:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Creating event network-changed:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:23:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134721 Nov 21 14:23:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-04bd5197-f891-45e1-8f1f-f7c4d3a9a300 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 200 len: 1691 microversion: 2.87 time: 0.874582 Nov 21 14:23:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 108/322] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:00 2023] GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 1691 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:23:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-44b4a13b-9642-4bee-a18e-d5ded5d8fe49 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086631 Nov 21 14:23:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:23:02 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 204 len: 0 microversion: 2.32 time: 0.195239 Nov 21 14:23:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 107/324] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:23:02 2023] DELETE /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:02 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'services' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-36a08d76-6532-4cd8-b7bb-5c99debab0ac tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 200 len: 2945 microversion: 2.32 time: 0.324014 Nov 21 14:23:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:02 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 2945 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:23:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 202 len: 0 microversion: 2.1 time: 0.291551 Nov 21 14:23:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:23:02 2023] DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-58abf880-2c38-410b-9b3c-2b1f0ea1d105 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086505 Nov 21 14:23:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:23:03 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "29164a1e-6f52-4e02-8bf9-af322c771dab"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Creating event network-vif-unplugged:29164a1e-6f52-4e02-8bf9-af322c771dab for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050321 Nov 21 14:23:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Creating event network-vif-unplugged:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052584 Nov 21 14:23:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:23:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "29164a1e-6f52-4e02-8bf9-af322c771dab"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}, {"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}, {"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:29164a1e-6f52-4e02-8bf9-af322c771dab for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-unplugged:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-unplugged:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-unplugged:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:23:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1557 microversion: 2.1 time: 0.058020 Nov 21 14:23:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 21 14:23:05 2023] POST /compute/v2.1/os-server-external-events => generated 1557 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:23:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Creating event network-vif-plugged:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048041 Nov 21 14:23:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d97f4b8f-ea9d-4ce2-8644-118038c5be6b tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-969012790", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e299f49f-d187-416d-a0de-f170d78a3ead", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a9ab1c2c-271a-4606-b53d-a309e4992de9"}]}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:06 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-d97f4b8f-ea9d-4ce2-8644-118038c5be6b tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] HTTP exception thrown: Block Device e299f49f-d187-416d-a0de-f170d78a3ead is not bootable. Nov 21 14:23:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d97f4b8f-ea9d-4ce2-8644-118038c5be6b tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 400 to user: Block Device e299f49f-d187-416d-a0de-f170d78a3ead is not bootable. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:23:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d97f4b8f-ea9d-4ce2-8644-118038c5be6b tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.102162 Nov 21 14:23:06 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 112/332] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:23:06 2023] POST /compute/v2.1/servers => generated 110 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Creating event network-vif-unplugged:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.248500 Nov 21 14:23:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:06 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a12de039-4d08-4589-8cb3-e093ff59ddb5 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1492 microversion: 2.1 time: 0.285055 Nov 21 14:23:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:06 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1492 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-2116261026", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd"}], "security_groups": [{"name": "tempest-securitygroup--2000989651"}], "key_name": "tempest-keypair-993669652", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3334939e-afed-4b86-8d82-eda72f7b2ff9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] validate_networks() for [('752c2c0f-3522-4c30-9f16-3e3678ceb9dd', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d78a1a-34cd-4673-ac41-572a523c57c0"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-plugged", "status": "completed", "tag": "f3d78a1a-34cd-4673-ac41-572a523c57c0"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for project a906ab977ca047e8aacb9c696f166a20. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for user ff48456740444cf8aee032129cc9f087 and project a906ab977ca047e8aacb9c696f166a20. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Creating event network-vif-plugged:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Creating event network-vif-unplugged:f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Creating event network-vif-plugged:f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.062977 Nov 21 14:23:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:23:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3334939e-afed-4b86-8d82-eda72f7b2ff9',volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-deleted", "tag": "a7ca135d-1184-4166-b185-bb4acf34d4bc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] Creating event network-vif-deleted:a7ca135d-1184-4166-b185-bb4acf34d4bc for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042076 Nov 21 14:23:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 0.924969 Nov 21 14:23:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 113/336] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:23:07 2023] POST /compute/v2.1/servers => generated 407 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:23:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 113/337] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-cc0278d2-e716-460e-b442-85007627e2be tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1333 microversion: 2.93 time: 0.155424 Nov 21 14:23:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 112/338] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:08 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:23:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-deleted", "tag": "cdccaae8-da2c-4767-b3da-21c792e1c4ce"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-deleted", "tag": "19c29b2e-3376-4dd9-9ccb-233249c5bc67"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-deleted", "tag": "c17f8fb0-313c-44e4-8d06-df35a52d365d"}, {"server_uuid": "d2fbf0ae-0e14-42aa-a25b-d349726bad95", "name": "network-vif-deleted", "tag": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Creating event network-vif-deleted:cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Creating event network-vif-deleted:19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Creating event network-vif-deleted:c17f8fb0-313c-44e4-8d06-df35a52d365d for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] Creating event network-vif-deleted:b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 on user Nov 21 14:23:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031595 Nov 21 14:23:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Creating event network-changed:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:23:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033132 Nov 21 14:23:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ae8f8748-8c72-433f-8ebc-857ea55009f2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.333262 Nov 21 14:23:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:23:18 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-interface => generated 282 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:19 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Creating event network-changed:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:23:19 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050988 Nov 21 14:23:19 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:20 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c1528185-1e07-4084-923f-2e8a7cc9da62 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1543 microversion: 2.1 time: 0.244645 Nov 21 14:23:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:19 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1543 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6daff34-cae1-4f15-a582-55aeaead48de"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357175 Nov 21 14:23:20 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 114/344] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:23:20 2023] POST /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:23:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042375 Nov 21 14:23:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:23:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043800 Nov 21 14:23:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-00a5f60c-ea83-40b5-910f-21f5c1b53ca5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095592 Nov 21 14:23:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:23:26 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:23:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 204 len: 0 microversion: 2.1 time: 0.127247 Nov 21 14:23:26 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:23:26 2023] DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:26 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-83a2c842-da79-4ad9-a68c-fe1f5d72adf2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 200 len: 1665 microversion: 2.1 time: 0.368336 Nov 21 14:23:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:26 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 1665 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Creating event network-vif-unplugged:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:23:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034833 Nov 21 14:23:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "name": "network-vif-deleted", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] Creating event network-vif-deleted:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:23:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047134 Nov 21 14:23:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee", "name": "network-vif-plugged", "status": "completed", "tag": "c0cf7d6d-fa0c-42c8-b031-069446ad2314"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Creating event network-vif-plugged:c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee on user Nov 21 14:23:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Nov 21 14:23:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:29 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'services' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:23:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments/949666e2-574c-4f9a-bad7-2074e7b4d4b4" status: 202 len: 0 microversion: 2.1 time: 0.497104 Nov 21 14:23:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:23:29 2023] DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments/949666e2-574c-4f9a-bad7-2074e7b4d4b4 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:30 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-87dbc204-797a-4b88-87f5-2022e1751c2d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1706 microversion: 2.1 time: 0.293298 Nov 21 14:23:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:30 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1706 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-550921415", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: dict_keys(['metadata_items']) {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: dict_keys(['metadata_items']) {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:23:30 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/action" status: 202 len: 1159 microversion: 2.1 time: 0.700762 Nov 21 14:23:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 21 14:23:30 2023] POST /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/action => generated 1159 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:31 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-45c367d0-39f7-4279-b6d7-0f26ce310c29 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1732 microversion: 2.1 time: 0.308934 Nov 21 14:23:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 118/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:31 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1732 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-unplugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Creating event network-vif-unplugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:23:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039080 Nov 21 14:23:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:23:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032082 Nov 21 14:23:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:23:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043509 Nov 21 14:23:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 119/359] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:23:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037961 Nov 21 14:23:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:48 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e983eadb-04a3-47c4-b4b0-6723345146ec tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1540 microversion: 2.1 time: 0.223426 Nov 21 14:23:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:47 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1540 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:52 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:52 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Going to try to stop instance {{(pid=64452) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 21 14:23:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action" status: 202 len: 0 microversion: 2.1 time: 0.074495 Nov 21 14:23:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 120/362] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:23:52 2023] POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d78793cd-e372-4652-a997-bc31d9bbcfe2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1661 microversion: 2.1 time: 0.289802 Nov 21 14:23:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 122/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:52 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1661 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-unplugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Creating event network-vif-unplugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:23:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040302 Nov 21 14:23:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HTTP exception thrown: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Returning 404 to user: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:23:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0c1a4fc3-69a4-449f-827b-8d210ec5dbea tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 404 len: 111 microversion: 2.32 time: 0.028644 Nov 21 14:23:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 121/365] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:53 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-beccf43b-1714-43c1-8880-baf9f7032786 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '.version_select at 0x7f76b131c8b0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-beccf43b-1714-43c1-8880-baf9f7032786 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738218210" status: 204 len: 0 microversion: 2.32 time: 0.045069 Nov 21 14:23:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 123/366] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 21 14:23:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738218210 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-86021070-814c-40e9-93a5-9c7e7f3a32fe tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048810 Nov 21 14:23:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:23:53 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] HTTP exception thrown: Instance 1ae17530-7c7f-48bf-a225-11be40152845 is not attached to volume 0ba22751-58d1-456d-be4d-ddcb85ff1a4f Nov 21 14:23:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Returning 404 to user: Instance 1ae17530-7c7f-48bf-a225-11be40152845 is not attached to volume 0ba22751-58d1-456d-be4d-ddcb85ff1a4f {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:23:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2a97d752-9d09-4d78-ac2b-c508ffe31ae6 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f" status: 404 len: 154 microversion: 2.1 time: 0.113442 Nov 21 14:23:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:23:53 2023] DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845/os-volume_attachments/0ba22751-58d1-456d-be4d-ddcb85ff1a4f => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:23:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 204 len: 0 microversion: 2.1 time: 0.118659 Nov 21 14:23:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:23:53 2023] DELETE /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:53 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fbd298f0-7d80-4ee6-afb0-6805a7d1f3e5 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 200 len: 1684 microversion: 2.1 time: 0.234444 Nov 21 14:23:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:23:53 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:23:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "name": "network-vif-unplugged", "status": "completed", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Creating event network-vif-unplugged:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:23:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040962 Nov 21 14:23:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 123/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:23:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 Nov 21 14:23:54 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 125/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "name": "network-vif-plugged", "status": "completed", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Creating event network-vif-plugged:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:23:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Nov 21 14:23:56 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:56 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae17530-7c7f-48bf-a225-11be40152845", "name": "network-vif-deleted", "tag": "50684016-dcd4-4d67-86ea-28f525147f47"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:23:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] Creating event network-vif-deleted:50684016-dcd4-4d67-86ea-28f525147f47 for instance 1ae17530-7c7f-48bf-a225-11be40152845 on user Nov 21 14:23:56 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045329 Nov 21 14:23:56 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 124/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HTTP exception thrown: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. Nov 21 14:23:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Returning 404 to user: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:23:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8396be2f-faa0-49be-9ae5-2574ff65f1bb tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 404 len: 111 microversion: 2.32 time: 0.054335 Nov 21 14:23:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 126/375] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:23:56 2023] DELETE /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HTTP exception thrown: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. Nov 21 14:23:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Returning 404 to user: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:23:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1255372d-da23-42bf-9dd2-a49e0c42518b tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95" status: 404 len: 111 microversion: 2.32 time: 0.034644 Nov 21 14:23:56 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 126/376] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:56 2023] GET /compute/v2.1/servers/d2fbf0ae-0e14-42aa-a25b-d349726bad95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:23:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b8a76796-2eb0-4b66-ae8d-ea99f45f9a86 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1721 microversion: 2.93 time: 0.280943 Nov 21 14:23:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 125/377] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:23:59 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0dce1732-fed3-4454-8850-69d1f2697d58 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.257412 Nov 21 14:24:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 127/378] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:24:00 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-interface => generated 282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-30825576"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Creating event network-changed:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:24:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044215 Nov 21 14:24:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:24:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/action" status: 202 len: 52 microversion: 2.87 time: 0.905708 Nov 21 14:24:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 127/380] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:24:01 2023] POST /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/action => generated 52 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553163a7-a13e-4a0b-8e91-75cd4744748a"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435919 Nov 21 14:24:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 128/381] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:24:04 2023] POST /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:07 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:07 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f7180679-b905-4519-b95d-7f43b8de1e3f tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1492 microversion: 2.1 time: 0.236738 Nov 21 14:24:07 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:06 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1492 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:09 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:09 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:09 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6d8088a8-8eed-4102-94cc-628e7c5b9685 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 200 len: 1691 microversion: 2.87 time: 0.596585 Nov 21 14:24:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 128/383] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:24:08 2023] GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 1691 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c10ec9a6-195d-4c6b-86db-8a82eb73ed5c"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] HTTP exception thrown: Volume c10ec9a6-195d-4c6b-86db-8a82eb73ed5c could not be found. Nov 21 14:24:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Returning 400 to user: Volume c10ec9a6-195d-4c6b-86db-8a82eb73ed5c could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:24:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f7e6ee23-9194-4b3c-adec-fac157aecc52 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments/553163a7-a13e-4a0b-8e91-75cd4744748a" status: 400 len: 107 microversion: 2.1 time: 0.241341 Nov 21 14:24:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 21 14:24:13 2023] PUT /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments/553163a7-a13e-4a0b-8e91-75cd4744748a => generated 107 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:13 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'services' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:24:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments/553163a7-a13e-4a0b-8e91-75cd4744748a" status: 202 len: 0 microversion: 2.1 time: 0.190836 Nov 21 14:24:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:24:13 2023] DELETE /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments/553163a7-a13e-4a0b-8e91-75cd4744748a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b54bb9c9-e42e-4d00-a52d-f39ca666722a tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053819 Nov 21 14:24:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:24:13 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. Nov 21 14:24:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:24:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8bd1562e-5610-4518-8191-9c4f5c684a27 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 404 len: 111 microversion: 2.1 time: 0.035146 Nov 21 14:24:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:16 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:24:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b7aa5710-5b1d-41ee-9ebd-9dbe79b4faba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '.version_select at 0x7f76b17ebd90>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b7aa5710-5b1d-41ee-9ebd-9dbe79b4faba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505302143" status: 202 len: 0 microversion: 2.1 time: 0.023004 Nov 21 14:24:16 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 129/388] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:24:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505302143 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:24:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-723daeb2-57f7-499d-baab-f1f505b3b926 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: .version_select at 0x7f76b14d5ea0>, body: {"keypair": {"name": "tempest-keypair-1826925508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9FoCMa2qacMZrO6msOrTejPTIdqOfPT3wLUrO03PPV4wxLHauD5Ij6qZ9JF9HMPqxdefkjCKf9UBlbZw8SnpjhUYA9sSwwIK+ESGHFVeAYclwTyns1asQc0+1IS2mdxg=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:17 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-723daeb2-57f7-499d-baab-f1f505b3b926 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:24:17 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-723daeb2-57f7-499d-baab-f1f505b3b926 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:24:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-723daeb2-57f7-499d-baab-f1f505b3b926 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055194 Nov 21 14:24:17 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 130/389] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:24:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-604809217", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87"}], "security_groups": [{"name": "tempest-securitygroup--407000840"}], "key_name": "tempest-keypair-1826925508", "user_data": "}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] validate_networks() for [('3ee5933d-610e-4e1b-91f4-1b2cceb04f87', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:24:19 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:24:19 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.609583 Nov 21 14:24:19 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 131/390] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:24:19 2023] POST /compute/v2.1/servers => generated 399 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 21 14:24:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7be1d09a-30a7-4341-a7f6-b1ce8697b309 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:19 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7be1d09a-30a7-4341-a7f6-b1ce8697b309 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:19 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-7be1d09a-30a7-4341-a7f6-b1ce8697b309 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7be1d09a-30a7-4341-a7f6-b1ce8697b309 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 200 len: 1233 microversion: 2.1 time: 0.066127 Nov 21 14:24:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:19 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 1233 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:22 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-00a32d1e-cd50-4d5a-ba73-34ae0f64eab7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1723 microversion: 2.1 time: 0.341498 Nov 21 14:24:22 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:21 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Creating event network-changed:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:24:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030342 Nov 21 14:24:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:24:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:24 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:24:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043709 Nov 21 14:24:24 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:24:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:24:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Nov 21 14:24:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:24:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:42 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9e58ea8b-749d-4607-adff-96c6fddfe3e8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1638 microversion: 2.1 time: 0.213952 Nov 21 14:24:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:42 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1638 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] HTTP exception thrown: Instance 1ae17530-7c7f-48bf-a225-11be40152845 could not be found. Nov 21 14:24:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Returning 404 to user: Instance 1ae17530-7c7f-48bf-a225-11be40152845 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:24:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-92226572-bcfb-4c68-905d-26d66f6f2804 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845" status: 404 len: 111 microversion: 2.1 time: 0.034857 Nov 21 14:24:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:43 2023] GET /compute/v2.1/servers/1ae17530-7c7f-48bf-a225-11be40152845 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:24:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f4a49c23-472c-42c3-aefc-3e611b7fe5d3 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Calling method '.version_select at 0x7f76b17cdfc0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f4a49c23-472c-42c3-aefc-3e611b7fe5d3 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472520468" status: 202 len: 0 microversion: 2.1 time: 0.031158 Nov 21 14:24:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:24:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472520468 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3f66c6c4-88d1-448c-84c8-f512648c6fa0 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.155114 Nov 21 14:24:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:24:48 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-interface => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:24:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Creating event network-changed:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:24:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032722 Nov 21 14:24:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:49 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-342a45cf-7fc4-4184-ada9-d0773cf6ef51 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1540 microversion: 2.1 time: 0.199953 Nov 21 14:24:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:49 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1540 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:49 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:24:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-255bb667-82bb-47e1-8a13-1bc88d5672f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1540 microversion: 2.1 time: 0.156538 Nov 21 14:24:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 135/402] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:24:49 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1540 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:24:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:24:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8f683f87-cc8e-42cd-9101-27a7e6d8c3d2 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.182305 Nov 21 14:24:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 134/403] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:24:59 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f/os-interface => generated 295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=16 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Creating event network-changed:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Nov 21 14:25:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f94b7bbf-e3b5-4be5-8e16-09d8fdd2a37b tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1721 microversion: 2.93 time: 0.237906 Nov 21 14:25:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 135/405] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:25:00 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-502558027", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for project a906ab977ca047e8aacb9c696f166a20. Resources: dict_keys(['metadata_items']) {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting quotas for user ff48456740444cf8aee032129cc9f087 and project a906ab977ca047e8aacb9c696f166a20. Resources: dict_keys(['metadata_items']) {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f/action" status: 202 len: 2044 microversion: 2.93 time: 0.691216 Nov 21 14:25:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 135/406] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 21 14:25:00 2023] POST /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f/action => generated 2044 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 21 14:25:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d218da47-38af-4123-b2a7-6ac5a930cfe7 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d218da47-38af-4123-b2a7-6ac5a930cfe7 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.018018 Nov 21 14:25:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 137/407] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 21 14:25:01 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:01 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-96f96701-fbd0-4a1f-b5c7-f9c31dd5921d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1867 microversion: 2.93 time: 0.272059 Nov 21 14:25:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 136/408] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:25:01 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1867 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:25:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-unplugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}, {"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Creating event network-vif-unplugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038052 Nov 21 14:25:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-56d588a6-409f-4165-8590-a48bedc2cf32 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086386 Nov 21 14:25:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 138/410] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:25:04 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:25:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-115556004", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "339e70be-6083-486f-b6a2-097ee63ca3e4"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:04 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] validate_networks() for [('339e70be-6083-486f-b6a2-097ee63ca3e4', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for project a26cdaa13ed94137bcb577358a2054dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting quotas for user 85844a0bfabd4095b647684ad7a1003a and project a26cdaa13ed94137bcb577358a2054dc. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:25:05 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:25:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.906435 Nov 21 14:25:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 137/411] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:25:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:25:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-63943ad4-20bd-4a70-bc67-f0039abbf29f tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:05 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-63943ad4-20bd-4a70-bc67-f0039abbf29f tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:05 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-63943ad4-20bd-4a70-bc67-f0039abbf29f tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-63943ad4-20bd-4a70-bc67-f0039abbf29f tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360" status: 200 len: 1209 microversion: 2.1 time: 0.075577 Nov 21 14:25:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 137/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:05 2023] GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360 => generated 1209 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:08 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Creating event network-changed:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:25:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074017 Nov 21 14:25:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 139/413] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-677425991", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "25c54848-a31e-4a8b-acba-2675da8ba572"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:09 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] validate_networks() for [('25c54848-a31e-4a8b-acba-2675da8ba572', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c87584e6-b56a-43d0-aff3-c21ee3afa074 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400327548", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "destination_type": "local"}, {"source_type": "volume", "uuid": "818382fc-b99c-459e-a6e8-ebb4b82b4367", "destination_type": "invalid"}], "networks": [{"uuid": "a9ab1c2c-271a-4606-b53d-a309e4992de9"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c87584e6-b56a-43d0-aff3-c21ee3afa074 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:25:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c87584e6-b56a-43d0-aff3-c21ee3afa074 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008440 Nov 21 14:25:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 138/414] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:25:09 2023] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:09 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e4a3a784-8627-4a10-a797-98415193bf76 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1492 microversion: 2.1 time: 0.194553 Nov 21 14:25:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 140/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:09 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1492 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for user 7635b3029cf14950a1978282d06bc8f3 and project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:25:10 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:25:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.822000 Nov 21 14:25:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 138/416] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:25:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:25:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:10 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-00ef43b6-0e73-4720-a336-33aa74f7f642 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 200 len: 1541 microversion: 2.1 time: 0.711331 Nov 21 14:25:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:09 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 1541 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-40ddb068-11bd-4a55-8ea8-64ef2d8e06a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1394 microversion: 2.87 time: 0.322966 Nov 21 14:25:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 141/418] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:25:10 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1394 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:25:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c0c9699c-9dea-401a-a9bd-e1870caec8b0 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: .version_select at 0x7f76b15104c0>, body: {"keypair": {"name": "tempest-keypair-1440997765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG3C2rVjflbNsS9fKtX50ZVRu5n7hGzzD2zwaWwS3KzXKPvBtd1mXi21f4ioMDYvXo98cbLQmUZWrfcw0qGCu34xhX57TDr4UvaDP0layliW8yevW9tj503nkyjdRiFJg=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:13 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c0c9699c-9dea-401a-a9bd-e1870caec8b0 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting quotas for project 391e0d9d2d344d06a315a6bbea613404. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:25:13 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c0c9699c-9dea-401a-a9bd-e1870caec8b0 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting quotas for user 45ba98964518472c872e959c17ca4f1e and project 391e0d9d2d344d06a315a6bbea613404. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:25:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c0c9699c-9dea-401a-a9bd-e1870caec8b0 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225217 Nov 21 14:25:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 139/419] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:25:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Creating event network-changed:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:25:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041632 Nov 21 14:25:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "name": "network-vif-plugged", "status": "completed", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Creating event network-vif-plugged:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:25:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039186 Nov 21 14:25:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:15 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "name": "network-vif-plugged", "status": "completed", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Creating event network-vif-plugged:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:25:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Nov 21 14:25:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 140/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:16 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-2128921177", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "key_name": "tempest-keypair-1440997765", "security_groups": [{"name": "tempest-secgroup-smoke-917031951"}, {"name": "tempest-securitygroup--1094436171"}], "networks": [{"uuid": "36a03207-b935-4278-88e1-4bded651091e"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] validate_networks() for [('36a03207-b935-4278-88e1-4bded651091e', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting quotas for project 391e0d9d2d344d06a315a6bbea613404. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting quotas for user 45ba98964518472c872e959c17ca4f1e and project 391e0d9d2d344d06a315a6bbea613404. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:25:17 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:25:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 0.799184 Nov 21 14:25:17 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 141/423] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:25:16 2023] POST /compute/v2.1/servers => generated 450 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:25:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3c0a13e6-3cf4-4480-9faf-3b15f4b00114 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:17 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3c0a13e6-3cf4-4480-9faf-3b15f4b00114 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:17 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3c0a13e6-3cf4-4480-9faf-3b15f4b00114 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ba98964518472c872e959c17ca4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391e0d9d2d344d06a315a6bbea613404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3c0a13e6-3cf4-4480-9faf-3b15f4b00114 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 200 len: 1236 microversion: 2.1 time: 0.067655 Nov 21 14:25:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 143/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:17 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "tag": "3334939e-afed-4b86-8d82-eda72f7b2ff9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Creating event volume-reimaged:3334939e-afed-4b86-8d82-eda72f7b2ff9 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.089739 Nov 21 14:25:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 141/425] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 21 14:25:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:25:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Creating event network-changed:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:25:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Nov 21 14:25:20 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:22 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c7837730-23cf-465c-a135-f20bcfb396b8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1723 microversion: 2.1 time: 0.201392 Nov 21 14:25:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:22 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:22 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "name": "network-vif-plugged", "status": "completed", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:22 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Creating event network-vif-plugged:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:25:22 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065988 Nov 21 14:25:22 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:22 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c958fea1-9e66-4991-8dfc-5cb1d3de6f9e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.243986 Nov 21 14:25:22 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 142/429] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:22 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "name": "network-vif-plugged", "status": "completed", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Creating event network-vif-plugged:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:25:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029484 Nov 21 14:25:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 145/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:25:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068670 Nov 21 14:25:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:29 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=16 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:25:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038687 Nov 21 14:25:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 143/432] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:30 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037268 Nov 21 14:25:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 146/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:25:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037050 Nov 21 14:25:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=28 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:40 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cfc33f50-9512-4677-b629-530e8b100d55 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1658 microversion: 2.1 time: 0.232108 Nov 21 14:25:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:40 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1658 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=28 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=28 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:40 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-275748ab-ba87-4f83-b2a5-fd0b98e1206a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1658 microversion: 2.1 time: 0.224602 Nov 21 14:25:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:40 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1658 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=5,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:42 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Going to try to start instance {{(pid=64452) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 21 14:25:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action" status: 202 len: 0 microversion: 2.1 time: 0.091478 Nov 21 14:25:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 146/437] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:25:42 2023] POST /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-34b700fb-ffeb-4d9b-8a71-99c871263238 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1647 microversion: 2.1 time: 0.223027 Nov 21 14:25:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:43 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1647 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:25:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:25:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043792 Nov 21 14:25:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 148/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:25:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:25:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029023 Nov 21 14:25:48 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 147/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9b5214c6-4dad-43cc-bd79-7af324b25395 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1858 microversion: 2.93 time: 0.316652 Nov 21 14:25:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 146/441] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:25:52 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1858 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:25:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:25:56 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:25:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-738fde53-9ca5-428d-96e2-d0809d7a2123 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360" status: 200 len: 1492 microversion: 2.1 time: 0.690272 Nov 21 14:25:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:25:55 2023] GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360 => generated 1492 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8f6a654e-8f02-4a5a-bed5-fcf1aa7c929a tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1768 microversion: 2.87 time: 0.227964 Nov 21 14:26:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 148/443] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:26:00 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1768 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=18 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ba98964518472c872e959c17ca4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391e0d9d2d344d06a315a6bbea613404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-23822aef-7ab8-440a-af61-706092c64087 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 200 len: 1594 microversion: 2.1 time: 0.282154 Nov 21 14:26:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:07 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 1594 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-50f63d67-e5a2-4278-8ece-2c6c3d7e83de tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.160389 Nov 21 14:26:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:26:10 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Creating event network-changed:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:26:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Nov 21 14:26:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 149/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-0076927c-68b4-435e-a2b7-4fd92711d488 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/ips" status: 200 len: 107 microversion: 2.1 time: 0.034325 Nov 21 14:26:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:26:11 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/ips => generated 107 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eecc96a4-4c9d-4267-8b5f-446fda932a64"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282931 Nov 21 14:26:14 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 151/448] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:26:14 2023] POST /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] HTTP exception thrown: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 404 to user: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:26:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e58d506c-6747-4d77-b1dc-8132fd33424e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 404 len: 111 microversion: 2.1 time: 0.028923 Nov 21 14:26:16 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:26:16 2023] DELETE /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] HTTP exception thrown: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. Nov 21 14:26:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 404 to user: Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:26:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f5f35727-ea0c-4667-8d00-aab695d72d2c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf" status: 404 len: 111 microversion: 2.1 time: 0.042008 Nov 21 14:26:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:16 2023] GET /compute/v2.1/servers/51a5901c-6c03-4b4d-8737-8780e7224fcf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:26:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 204 len: 0 microversion: 2.1 time: 0.138469 Nov 21 14:26:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 152/451] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:26:16 2023] DELETE /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "name": "network-vif-unplugged", "status": "completed", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:17 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Creating event network-vif-unplugged:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:26:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-621e9a06-6339-4e58-bdf4-3fb4c4bff4c2 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 200 len: 1498 microversion: 2.1 time: 0.276877 Nov 21 14:26:17 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:16 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 1498 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:26:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034397 Nov 21 14:26:17 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 150/453] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "name": "network-vif-deleted", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] Creating event network-vif-deleted:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:26:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Nov 21 14:26:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 153/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca", "name": "network-vif-plugged", "status": "completed", "tag": "f173e853-6ea8-452e-8db2-e8a975c2f5df"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Creating event network-vif-plugged:f173e853-6ea8-452e-8db2-e8a975c2f5df for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca on user Nov 21 14:26:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029097 Nov 21 14:26:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'services' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:26:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments/d6daff34-cae1-4f15-a582-55aeaead48de" status: 202 len: 0 microversion: 2.1 time: 0.168174 Nov 21 14:26:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 151/456] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:26:22 2023] DELETE /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments/d6daff34-cae1-4f15-a582-55aeaead48de => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d8262bc8-32aa-4664-8a86-e3afc72dd03e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062819 Nov 21 14:26:23 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 154/457] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:26:23 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eecc96a4-4c9d-4267-8b5f-446fda932a64"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Invalid volume: volume eecc96a4-4c9d-4267-8b5f-446fda932a64 is already attached to instances: a76d5dda-a6c7-4e62-8471-16c8c99344da Nov 21 14:26:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 400 to user: Invalid volume: volume eecc96a4-4c9d-4267-8b5f-446fda932a64 is already attached to instances: a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:26:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0d583eeb-243b-4a7a-9cfc-5a3efcb74a83 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098966 Nov 21 14:26:23 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 153/458] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:26:23 2023] POST /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'services' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:26:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments/eecc96a4-4c9d-4267-8b5f-446fda932a64" status: 202 len: 0 microversion: 2.1 time: 0.154979 Nov 21 14:26:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 152/459] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:26:23 2023] DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments/eecc96a4-4c9d-4267-8b5f-446fda932a64 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-64841adc-9a58-4c71-9bf7-cef02fac490c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Nov 21 14:26:23 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 155/460] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:26:23 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:33 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c1085342-b9b8-4053-8302-a390c880cbc7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1651 microversion: 2.1 time: 0.229487 Nov 21 14:26:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:33 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1651 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-65c9d7fc-2c47-42ac-afbc-4b5912a4bccc tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1658 microversion: 2.1 time: 0.188246 Nov 21 14:26:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 153/462] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:42 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1658 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80204876-2834-4680-8b28-90fd14c4ae35"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273851 Nov 21 14:26:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 156/463] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:26:43 2023] POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=24 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Old instance type m1.tiny, new instance type m1.small {{(pid=64452) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for project ccf822369a824ed3912173b2f27fddbf. Resources: {'cores', 'ram'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting quotas for user a19fbffc4df04656950aa2bb1a2bb48a and project ccf822369a824ed3912173b2f27fddbf. Resources: {'cores', 'ram'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:26:52 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:26:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/action" status: 202 len: 0 microversion: 2.1 time: 0.405611 Nov 21 14:26:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 155/464] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:26:51 2023] POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-162fe0d4-6056-48f2-a295-66685294169e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1713 microversion: 2.1 time: 0.185249 Nov 21 14:26:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 154/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:26:52 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1713 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3870af06-6a5e-45dd-ad14-8fbf3d755140 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1858 microversion: 2.93 time: 0.253349 Nov 21 14:26:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 157/466] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:26:52 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1858 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:26:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 204 len: 0 microversion: 2.93 time: 0.152323 Nov 21 14:26:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 156/467] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:26:53 2023] DELETE /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:53 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:26:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-948fb7b9-7519-4f8e-96f3-c1ebab3a581d tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 200 len: 1864 microversion: 2.93 time: 0.315425 Nov 21 14:26:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 155/468] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:26:53 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 1864 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:26:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-unplugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Creating event network-vif-unplugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:26:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037965 Nov 21 14:26:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 158/469] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-unplugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Creating event network-vif-unplugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:26:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:26:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057597 Nov 21 14:26:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 157/470] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-plugged", "status": "completed", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Creating event network-vif-plugged:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:26:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043155 Nov 21 14:26:55 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 156/471] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}, {"server_uuid": "9fe53976-492f-40b7-bf48-cfbfc337af0f", "name": "network-vif-deleted", "tag": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:26:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Creating event network-vif-deleted:9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f on user Nov 21 14:26:57 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:26:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071079 Nov 21 14:26:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 159/472] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac76099-a3ba-4f93-b2f9-44c92151b84c"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:26:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] HTTP exception thrown: Volume 8e0eac85-6d24-40d5-9d33-c3f73e8061a3 could not be found. Nov 21 14:26:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] Returning 404 to user: Volume 8e0eac85-6d24-40d5-9d33-c3f73e8061a3 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:26:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0a73c6e4-8cc7-4162-b7ce-dbc4d1a11238 tempest-VolumesAdminNegativeTest-362029728 tempest-VolumesAdminNegativeTest-362029728-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360/os-volume_attachments/8e0eac85-6d24-40d5-9d33-c3f73e8061a3" status: 404 len: 109 microversion: 2.1 time: 0.074074 Nov 21 14:26:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 158/473] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 21 14:26:58 2023] PUT /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360/os-volume_attachments/8e0eac85-6d24-40d5-9d33-c3f73e8061a3 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "7d1c98b6-5171-4cd1-a8e6-1823e58e1598"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:01 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'flavor' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:27:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/action" status: 200 len: 29 microversion: 2.87 time: 0.512399 Nov 21 14:27:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 157/474] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:27:01 2023] POST /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/action => generated 29 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:02 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f2828683-9ded-4b6a-8fc2-5cf367935e94 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1774 microversion: 2.87 time: 0.287385 Nov 21 14:27:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 160/475] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:27:02 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1774 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:27:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-unplugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Creating event network-vif-unplugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:27:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035008 Nov 21 14:27:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 159/476] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:27:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360" status: 204 len: 0 microversion: 2.1 time: 0.147655 Nov 21 14:27:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 158/477] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:27:03 2023] DELETE /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:03 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-99c24bb4-c774-43a0-b188-c575169a27a8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360" status: 200 len: 1498 microversion: 2.1 time: 0.261453 Nov 21 14:27:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 161/478] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:03 2023] GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360 => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "name": "network-vif-unplugged", "status": "completed", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Creating event network-vif-unplugged:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:27:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043069 Nov 21 14:27:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 160/479] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:27:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Nov 21 14:27:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 159/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "name": "network-vif-deleted", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] Creating event network-vif-deleted:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:27:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038740 Nov 21 14:27:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e856f-1904-4a99-ba39-4e05adbe2360", "name": "network-vif-plugged", "status": "completed", "tag": "983863ad-bbc2-4827-ac00-16638fbbf0a7"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Creating event network-vif-plugged:983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance aa2e856f-1904-4a99-ba39-4e05adbe2360 on user Nov 21 14:27:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030202 Nov 21 14:27:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 161/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] HTTP exception thrown: Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca could not be found. Nov 21 14:27:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Returning 404 to user: Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:27:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-10c05854-9da1-4bbc-9a8a-6270f7ebf85c tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" status: 404 len: 111 microversion: 2.1 time: 0.029430 Nov 21 14:27:07 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 160/483] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:07 2023] GET /compute/v2.1/servers/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:27:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:27:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Nov 21 14:27:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 163/484] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5cb17b8c-4c2f-40ac-9c3c-84883b567a10 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.197830 Nov 21 14:27:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 162/485] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:27:08 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-interface => generated 282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Creating event network-changed:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:27:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033348 Nov 21 14:27:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 161/486] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:09 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ba98964518472c872e959c17ca4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391e0d9d2d344d06a315a6bbea613404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6ff64885-e884-43fa-9f41-9d3705219ef2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 200 len: 1594 microversion: 2.1 time: 0.327426 Nov 21 14:27:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 164/487] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:09 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 1594 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:27:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:27:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040836 Nov 21 14:27:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 163/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:27:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Nov 21 14:27:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 162/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:27:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:11 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:27:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:27:11 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043842 Nov 21 14:27:11 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 165/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74f2bc96-8feb-411b-b075-6000893ad60b"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331624 Nov 21 14:27:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 164/491] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:27:12 2023] POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2b26d6ee-dbe6-48d8-a95a-c0ae83a851a1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050063 Nov 21 14:27:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 163/492] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:27:13 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:27:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 204 len: 0 microversion: 2.1 time: 0.193557 Nov 21 14:27:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 166/493] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:27:13 2023] DELETE /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-unplugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Creating event network-vif-unplugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:27:13 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051472 Nov 21 14:27:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 164/494] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-155e3215-5bc3-48fd-9221-b350ef3e9d39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 200 len: 1683 microversion: 2.1 time: 0.314407 Nov 21 14:27:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 165/495] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:13 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 1683 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-47aabd6c-9408-41c5-8446-d7617eed644c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074086 Nov 21 14:27:14 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 167/496] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:27:13 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:27:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 204 len: 0 microversion: 2.1 time: 0.376483 Nov 21 14:27:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 165/497] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:27:14 2023] DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:14 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9e227dbe-a14c-4270-af6a-3ab0edac1ce8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 200 len: 1666 microversion: 2.1 time: 0.388501 Nov 21 14:27:14 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 166/498] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:14 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 1666 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-deleted", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] Creating event network-vif-deleted:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:27:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052104 Nov 21 14:27:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 168/499] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29684d3-c5fd-4336-abc3-5da416e300e2", "name": "network-vif-plugged", "status": "completed", "tag": "767f656d-f7c7-4ab0-8727-9c0142c27b7f"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-unplugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Creating event network-vif-plugged:767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance e29684d3-c5fd-4336-abc3-5da416e300e2 on user Nov 21 14:27:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Creating event network-vif-unplugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.068756 Nov 21 14:27:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 166/500] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:16 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-unplugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-plugged", "status": "completed", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}, {"server_uuid": "a76d5dda-a6c7-4e62-8471-16c8c99344da", "name": "network-vif-deleted", "tag": "ac3237ae-45f1-4e33-98c3-521fcbe48dde"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Creating event network-vif-unplugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Creating event network-vif-plugged:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Creating event network-vif-deleted:ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance a76d5dda-a6c7-4e62-8471-16c8c99344da on user Nov 21 14:27:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.039678 Nov 21 14:27:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 167/501] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:18 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:33 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:33 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-cff623f3-4ef4-46a0-8a23-4bd59288f147 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055158 Nov 21 14:27:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 169/502] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:27:33 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:27:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 204 len: 0 microversion: 2.1 time: 0.215869 Nov 21 14:27:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 167/503] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:27:34 2023] DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3bc26729-8b7e-4fa0-bbb1-84198a20f912 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 200 len: 1657 microversion: 2.1 time: 0.347232 Nov 21 14:27:34 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 168/504] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:34 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 1657 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-unplugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Creating event network-vif-unplugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:27:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031013 Nov 21 14:27:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 170/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:36 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'services' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:27:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/74f2bc96-8feb-411b-b075-6000893ad60b" status: 202 len: 0 microversion: 2.1 time: 0.308234 Nov 21 14:27:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 168/506] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:27:36 2023] DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/74f2bc96-8feb-411b-b075-6000893ad60b => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-282383ac-5500-4812-82d6-ca9be2d2e70f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058865 Nov 21 14:27:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 169/507] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:27:36 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-plugged", "status": "completed", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}, {"server_uuid": "7892830a-13fc-48a2-bfd3-29a96b2a9113", "name": "network-vif-deleted", "tag": "f39421d4-14c9-470b-9aab-7c4b25deccd2"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Creating event network-vif-plugged:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:27:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Creating event network-vif-deleted:f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 on user Nov 21 14:27:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032424 Nov 21 14:27:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 171/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:42 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-721c0ca4-0a81-4971-8420-2c29852138ad tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1712 microversion: 2.1 time: 0.192702 Nov 21 14:27:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 169/509] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:42 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1712 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] HTTP exception thrown: Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f could not be found. Nov 21 14:27:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Returning 404 to user: Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:27:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-83e0e7de-fa98-48fa-abec-2904e6168f89 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f" status: 404 len: 111 microversion: 2.93 time: 0.030401 Nov 21 14:27:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 170/510] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:27:43 2023] GET /compute/v2.1/servers/9fe53976-492f-40b7-bf48-cfbfc337af0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:27:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1a25f03d-2ed5-4b73-9ed4-b3c3dbfbbad0 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Calling method '.version_select at 0x7f76b13929e0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1a25f03d-2ed5-4b73-9ed4-b3c3dbfbbad0 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993669652" status: 204 len: 0 microversion: 2.93 time: 0.035518 Nov 21 14:27:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 172/511] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 21 14:27:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993669652 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:52 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-99992ba3-8a1d-4570-9038-7d3bddd86cc3 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1754 microversion: 2.87 time: 0.401391 Nov 21 14:27:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 170/512] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:27:52 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1754 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] HTTP exception thrown: Instance aa2e856f-1904-4a99-ba39-4e05adbe2360 could not be found. Nov 21 14:27:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Returning 404 to user: Instance aa2e856f-1904-4a99-ba39-4e05adbe2360 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:27:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f357a464-78b4-4bd6-8580-e7bf29f945c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360" status: 404 len: 111 microversion: 2.1 time: 0.197784 Nov 21 14:27:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 171/513] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:53 2023] GET /compute/v2.1/servers/aa2e856f-1904-4a99-ba39-4e05adbe2360 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=10 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:27:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b" status: 204 len: 0 microversion: 2.1 time: 0.121582 Nov 21 14:27:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 173/514] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:27:59 2023] DELETE /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:59 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:27:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a4aecd30-7cf2-4b7f-85bf-fb4fcce68a70 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b" status: 200 len: 1665 microversion: 2.1 time: 0.246623 Nov 21 14:27:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:27:59 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b => generated 1665 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:27:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "name": "network-vif-unplugged", "status": "completed", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:27:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:27:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:27:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:27:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Creating event network-vif-unplugged:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:27:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111628 Nov 21 14:27:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 172/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:27:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "name": "network-vif-deleted", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] Creating event network-vif-deleted:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:28:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034647 Nov 21 14:28:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 174/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238ef1f-4d57-472f-b902-33aae507931b", "name": "network-vif-plugged", "status": "completed", "tag": "a9efa405-53bc-47b6-831c-8bae5302754f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Creating event network-vif-plugged:a9efa405-53bc-47b6-831c-8bae5302754f for instance 4238ef1f-4d57-472f-b902-33aae507931b on user Nov 21 14:28:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Nov 21 14:28:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 172/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HTTP exception thrown: Instance e29684d3-c5fd-4336-abc3-5da416e300e2 could not be found. Nov 21 14:28:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Returning 404 to user: Instance e29684d3-c5fd-4336-abc3-5da416e300e2 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:28:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c2524a30-49aa-4313-9654-eca79cc25307 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2" status: 404 len: 111 microversion: 2.1 time: 0.031736 Nov 21 14:28:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:03 2023] GET /compute/v2.1/servers/e29684d3-c5fd-4336-abc3-5da416e300e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:28:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-789a8331-7e81-46fe-871e-43c37ed46a4c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '.version_select at 0x7f76b152fa30>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-789a8331-7e81-46fe-871e-43c37ed46a4c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536111499" status: 202 len: 0 microversion: 2.1 time: 0.023841 Nov 21 14:28:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 175/520] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:28:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536111499 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:04 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-bcaecf5b-3e81-478b-beb4-d32c8c5a952b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.208317 Nov 21 14:28:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 173/521] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:04 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:28:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9a003f6c-f441-45ae-a20f-af6d50f1f0b4 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 404 len: 111 microversion: 2.1 time: 0.158086 Nov 21 14:28:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 174/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:04 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:28:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-de38818d-5f7a-4abb-9394-e1150dedf946 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '.version_select at 0x7f76b13bb910>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-de38818d-5f7a-4abb-9394-e1150dedf946 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826925508" status: 202 len: 0 microversion: 2.1 time: 0.027066 Nov 21 14:28:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 174/523] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:28:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826925508 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:05 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6239325d-1b46-49df-a0d0-2d197e40dcda tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.466937 Nov 21 14:28:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 176/524] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:05 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:05 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-33c7bbb8-fcf0-49b6-abb5-58e979feecf3 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1658 microversion: 2.1 time: 0.297843 Nov 21 14:28:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 175/525] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:05 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1658 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8d77f1f7-6c88-415f-bb2c-eeb8ba396112 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: .version_select at 0x7f76b11ac430>, body: {"keypair": {"name": "tempest-keypair-740459586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LK5wibZIOBbPogA8ShMLJsBp29tS9U/yH2c8rOMZPif+igCe47OOPKt9Q4MqgvofUlhEeB2RyAkIQVGobhUH7J4eg1rL+SoPrAdzSsdyoiGkMsQuAbudPcqZMW8sr3w=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:05 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8d77f1f7-6c88-415f-bb2c-eeb8ba396112 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:05 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8d77f1f7-6c88-415f-bb2c-eeb8ba396112 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8d77f1f7-6c88-415f-bb2c-eeb8ba396112 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053693 Nov 21 14:28:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 175/526] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:28:05 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-273719294", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87"}], "security_groups": [{"name": "tempest-securitygroup--2106556643"}], "key_name": "tempest-keypair-740459586", "user_data": "}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:07 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] validate_networks() for [('3ee5933d-610e-4e1b-91f4-1b2cceb04f87', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting quotas for user d55abe8426b34d10b31ff6b0aefddd37 and project dadaa9830cd54eb09daee40d952be38f. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:28:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:28:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.557869 Nov 21 14:28:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 177/527] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:28:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:28:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dc722f8a-f367-4ddb-90ed-539393c41ce3 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dc722f8a-f367-4ddb-90ed-539393c41ce3 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:08 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-dc722f8a-f367-4ddb-90ed-539393c41ce3 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dc722f8a-f367-4ddb-90ed-539393c41ce3 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 200 len: 1232 microversion: 2.1 time: 0.077348 Nov 21 14:28:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 176/528] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:08 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 1232 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Creating event network-changed:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:28:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146978 Nov 21 14:28:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 176/529] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "name": "network-vif-plugged", "status": "completed", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Creating event network-vif-plugged:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:28:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045102 Nov 21 14:28:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 178/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "name": "network-vif-plugged", "status": "completed", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Creating event network-vif-plugged:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:28:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031733 Nov 21 14:28:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 177/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. Nov 21 14:28:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:28:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f333fe26-2152-4ba4-85f4-270691293395 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 404 len: 111 microversion: 2.1 time: 0.044485 Nov 21 14:28:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:24 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:28:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bc4aa03c-e93a-4e7d-bd67-77bc381d96a6 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '.version_select at 0x7f76b131c8b0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bc4aa03c-e93a-4e7d-bd67-77bc381d96a6 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671638300" status: 202 len: 0 microversion: 2.1 time: 0.041155 Nov 21 14:28:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 179/533] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:28:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671638300 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=16 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=16 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9b27cc54-df40-466f-a67a-eb1bef787ae8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: .version_select at 0x7f76b162b6d0>, body: {"keypair": {"name": "tempest-keypair-1711900749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfjBdUaeg5gBMzRCIC2CLsKPZxcHOKYD5qYtqN1/wF9/M2H5BGBIvefGyVawGV2+mQ5eBpSZ0rozkc8ojAdQgF74dQtDNJ6Q333DFnreFkyQAnkBfUkLkWnCnqPtz+Tg=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-9b27cc54-df40-466f-a67a-eb1bef787ae8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for project 894802e2e3d044199467be931dd8e036. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:25 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-9b27cc54-df40-466f-a67a-eb1bef787ae8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for user c0cb90d4bdf74f9390124833ea8331bd and project 894802e2e3d044199467be931dd8e036. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9b27cc54-df40-466f-a67a-eb1bef787ae8 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055176 Nov 21 14:28:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 178/534] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:28:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-30007a2a-7e68-406f-a562-6a46828cdaba tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047263 Nov 21 14:28:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 178/535] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:28:26 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:28:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-666390476", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "04f88176-57de-4a45-96e0-55319f3d0f1f"}], "security_groups": [{"name": "tempest-securitygroup--1472099747"}], "key_name": "tempest-keypair-1711900749", "user_data": "}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:27 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] validate_networks() for [('04f88176-57de-4a45-96e0-55319f3d0f1f', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for project 894802e2e3d044199467be931dd8e036. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting quotas for user c0cb90d4bdf74f9390124833ea8331bd and project 894802e2e3d044199467be931dd8e036. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:28:28 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:28:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.628117 Nov 21 14:28:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 180/536] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:28:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:28:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-de2e7343-5949-417d-8b90-8836a127b9e1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:28 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-de2e7343-5949-417d-8b90-8836a127b9e1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:28 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-de2e7343-5949-417d-8b90-8836a127b9e1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-de2e7343-5949-417d-8b90-8836a127b9e1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 200 len: 1229 microversion: 2.1 time: 0.078754 Nov 21 14:28:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 179/537] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:28 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 1229 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13cbcfe3-a17f-4e37-afd6-47e28eed9d90"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393708 Nov 21 14:28:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 179/538] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:28:28 2023] POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Creating event network-changed:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:28:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035565 Nov 21 14:28:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 181/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:28:34 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "name": "network-vif-plugged", "status": "completed", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Creating event network-vif-plugged:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:28:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038087 Nov 21 14:28:34 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 180/540] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:36 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "name": "network-vif-plugged", "status": "completed", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Creating event network-vif-plugged:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:28:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Nov 21 14:28:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 180/541] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1394546310", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] validate_networks() for None {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Getting quotas for project 357e5035226846ffac018b95ba6a9853. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Getting quotas for user e026bd9694a247cdab93467d43b9f57b and project 357e5035226846ffac018b95ba6a9853. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:28:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:28:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.558213 Nov 21 14:28:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 182/542] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:28:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:28:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b1604bfd-5cd2-4c05-ad45-6f0601bca8d0 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b1604bfd-5cd2-4c05-ad45-6f0601bca8d0 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:37 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-b1604bfd-5cd2-4c05-ad45-6f0601bca8d0 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026bd9694a247cdab93467d43b9f57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357e5035226846ffac018b95ba6a9853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b1604bfd-5cd2-4c05-ad45-6f0601bca8d0 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9" status: 200 len: 1207 microversion: 2.1 time: 0.068152 Nov 21 14:28:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 181/543] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:37 2023] GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9 => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1129360862", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "1c3454df-506b-4b57-a1b8-7d5145019fba"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:38 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] validate_networks() for [('1c3454df-506b-4b57-a1b8-7d5145019fba', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting quotas for project a42118796db243d7a72988931f9915fc. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting quotas for user a95c719f033946038ed21c53704577b1 and project a42118796db243d7a72988931f9915fc. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:28:39 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:28:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.711510 Nov 21 14:28:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 181/544] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:28:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:28:39 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5e63b555-b944-458e-91f6-8e9e6ee119c2 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:39 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5e63b555-b944-458e-91f6-8e9e6ee119c2 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:39 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5e63b555-b944-458e-91f6-8e9e6ee119c2 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5e63b555-b944-458e-91f6-8e9e6ee119c2 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54" status: 200 len: 1206 microversion: 2.1 time: 0.072029 Nov 21 14:28:39 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 183/545] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:39 2023] GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54 => generated 1206 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Creating event network-changed:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:28:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193326 Nov 21 14:28:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 182/546] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:41 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'services' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:28:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/13cbcfe3-a17f-4e37-afd6-47e28eed9d90" status: 202 len: 0 microversion: 2.1 time: 0.193843 Nov 21 14:28:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 182/547] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:28:41 2023] DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/13cbcfe3-a17f-4e37-afd6-47e28eed9d90 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3ebcf8eb-0add-4d98-a51d-e34882696d0b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048013 Nov 21 14:28:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 184/548] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:28:41 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Creating event network-changed:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:28:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048121 Nov 21 14:28:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 183/549] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/action" status: 202 len: 0 microversion: 2.1 time: 0.404492 Nov 21 14:28:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 183/550] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:28:42 2023] POST /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:43 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8a785109-f2ec-42c6-82c9-1dcd91ea42f3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1711 microversion: 2.1 time: 0.342639 Nov 21 14:28:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 185/551] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:43 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1711 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-unplugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Creating event network-vif-unplugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:28:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:28:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043681 Nov 21 14:28:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 184/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "name": "network-vif-plugged", "status": "completed", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}, {"server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "name": "network-vif-plugged", "status": "completed", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Creating event network-vif-plugged:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:28:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Creating event network-vif-plugged:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:28:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031493 Nov 21 14:28:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 184/553] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}, {"server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "name": "network-vif-plugged", "status": "completed", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}, {"server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "name": "network-vif-plugged", "status": "completed", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:28:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Creating event network-vif-plugged:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:28:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Creating event network-vif-plugged:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:28:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:28:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048619 Nov 21 14:28:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 186/554] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] HTTP exception thrown: Instance 4238ef1f-4d57-472f-b902-33aae507931b could not be found. Nov 21 14:28:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Returning 404 to user: Instance 4238ef1f-4d57-472f-b902-33aae507931b could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:28:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-36778bda-5e38-47bf-be6d-f28d3aab7ea8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b" status: 404 len: 111 microversion: 2.1 time: 0.032921 Nov 21 14:28:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 185/555] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:49 2023] GET /compute/v2.1/servers/4238ef1f-4d57-472f-b902-33aae507931b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:28:49 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:49 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2d980a5e-9cce-4d52-a347-fa4049f2ece8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Calling method '.version_select at 0x7f76b0f0cd30>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2d980a5e-9cce-4d52-a347-fa4049f2ece8 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-829674788" status: 202 len: 0 microversion: 2.1 time: 0.033772 Nov 21 14:28:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 185/556] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:28:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-829674788 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/action" status: 202 len: 0 microversion: 2.87 time: 0.174872 Nov 21 14:28:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 187/557] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:28:52 2023] POST /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:53 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-73ddf287-3777-4924-9028-d4d7f8be31a1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1762 microversion: 2.87 time: 0.483448 Nov 21 14:28:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 186/558] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:28:53 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1762 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:28:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-unplugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Creating event network-vif-unplugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:28:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032270 Nov 21 14:28:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 186/559] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:28:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057032 Nov 21 14:28:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 188/560] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}, {"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:28:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:28:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045881 Nov 21 14:28:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 187/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:58 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:28:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6a5e66bf-7c54-4a0b-b988-01c84981ca36 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 200 len: 1541 microversion: 2.1 time: 0.435614 Nov 21 14:28:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 187/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:28:58 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 1541 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:28:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:28:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:28:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:28:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:28:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:28:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:28:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124756 Nov 21 14:28:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 189/563] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:28:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:29:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040775 Nov 21 14:29:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 188/564] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-175800306", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:06 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] validate_networks() for [('758c2446-6e4b-4069-b657-f62d55115a7e', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for user 4b8ebb88fee544a793fd71ebeee0845f and project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:29:07 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:29:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.697067 Nov 21 14:29:07 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 188/565] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:29:06 2023] POST /compute/v2.1/servers => generated 381 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:29:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9bdfd0a0-806d-46ae-a5bd-dbe25caa7e11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:07 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9bdfd0a0-806d-46ae-a5bd-dbe25caa7e11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:07 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-9bdfd0a0-806d-46ae-a5bd-dbe25caa7e11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9bdfd0a0-806d-46ae-a5bd-dbe25caa7e11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1213 microversion: 2.1 time: 0.113397 Nov 21 14:29:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 190/566] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:07 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-71590957", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] validate_networks() for [('758c2446-6e4b-4069-b657-f62d55115a7e', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:08 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:29:08 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for user 4b8ebb88fee544a793fd71ebeee0845f and project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:29:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:29:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:29:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.630833 Nov 21 14:29:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 189/567] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:29:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:29:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1c70275d-7ee9-4dc7-a317-f70a37cec6ca tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1c70275d-7ee9-4dc7-a317-f70a37cec6ca tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-1c70275d-7ee9-4dc7-a317-f70a37cec6ca tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1c70275d-7ee9-4dc7-a317-f70a37cec6ca tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 200 len: 1212 microversion: 2.1 time: 0.084582 Nov 21 14:29:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:08 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:29:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Creating event network-changed:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:29:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042754 Nov 21 14:29:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 191/569] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-765597573", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "af07711f-e1bf-40bf-9cdc-f912efa55fcd"}], "security_groups": [{"name": "tempest-securitygroup--1877222913"}], "key_name": "tempest-keypair-367225751", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5b68b64e-527c-465a-96b2-a2fa96e9cb6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] validate_networks() for [('af07711f-e1bf-40bf-9cdc-f912efa55fcd', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:29:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Creating event network-changed:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:29:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036964 Nov 21 14:29:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 190/570] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:29:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b68b64e-527c-465a-96b2-a2fa96e9cb6f',volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:29:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.057658 Nov 21 14:29:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 190/571] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:29:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:29:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c9db3d7d-e863-444f-9430-f281f25fc3c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c9db3d7d-e863-444f-9430-f281f25fc3c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:12 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c9db3d7d-e863-444f-9430-f281f25fc3c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c9db3d7d-e863-444f-9430-f281f25fc3c1 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1074 microversion: 2.1 time: 0.072871 Nov 21 14:29:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 192/572] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:11 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1074 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:29:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050657 Nov 21 14:29:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 191/573] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:29:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:29:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049206 Nov 21 14:29:14 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 191/574] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}, {"name": "network-changed", "server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:29:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Creating event network-changed:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:29:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035634 Nov 21 14:29:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 193/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:29:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Nov 21 14:29:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 192/576] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:18 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dc1a31e9-740b-4ed1-99e4-f8e04afac410 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 200 len: 1535 microversion: 2.1 time: 0.248804 Nov 21 14:29:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 192/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:18 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 1535 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:22 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:29:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043788 Nov 21 14:29:23 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 194/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:25 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:29:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047009 Nov 21 14:29:25 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 193/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:29:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=35 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:27 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026bd9694a247cdab93467d43b9f57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357e5035226846ffac018b95ba6a9853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-750df3ab-4fd8-4326-82a3-de408ac56935 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9" status: 200 len: 1453 microversion: 2.1 time: 0.228247 Nov 21 14:29:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 193/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:27 2023] GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9 => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:29 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-85c22ea2-52e4-4512-8888-f068653dc1fb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54" status: 200 len: 1484 microversion: 2.1 time: 0.229056 Nov 21 14:29:29 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 195/581] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:29 2023] GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54 => generated 1484 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6055cf4e-e0bc-427f-a2ca-b3ce5d05e6ec tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047675 Nov 21 14:29:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 194/582] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:29:31 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:33 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-18557212-6cea-437a-9d06-ab5d5879a0ba tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1704 microversion: 2.1 time: 0.211083 Nov 21 14:29:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 194/583] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:33 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1704 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24452970-3b54-4c81-bf93-7813ddff4cf5"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337057 Nov 21 14:29:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 196/584] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:29:34 2023] POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=7 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9e1c7bf7-8f87-4d4c-96cb-d6be4e39e2cd tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1768 microversion: 2.87 time: 0.214294 Nov 21 14:29:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 195/585] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:29:43 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1768 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=11 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:46 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'services' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:29:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/24452970-3b54-4c81-bf93-7813ddff4cf5" status: 202 len: 0 microversion: 2.1 time: 0.175272 Nov 21 14:29:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 195/586] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:29:46 2023] DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/24452970-3b54-4c81-bf93-7813ddff4cf5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b9236098-e201-41fc-b0b9-b3d707fc90b2 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054127 Nov 21 14:29:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 197/587] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:29:46 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:58 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:29:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1b031f64-e777-4077-8d5f-dc924739679d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 200 len: 1501 microversion: 2.1 time: 0.214004 Nov 21 14:29:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 196/588] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:29:58 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:29:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:29:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bc73c799-b136-452f-9d5e-46b1d07c7b6b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.148926 Nov 21 14:29:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 196/589] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:29:58 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-interface => generated 282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Creating event network-changed:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:30:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039600 Nov 21 14:30:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 198/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-74c40bd9-b86e-487c-bf15-e8970d9c5dfb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/ips" status: 200 len: 107 microversion: 2.1 time: 0.036785 Nov 21 14:30:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 197/591] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:30:00 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/ips => generated 107 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:02 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f0589524-555c-4e83-aaa1-f2b732a7bb5f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1429 microversion: 2.1 time: 0.215487 Nov 21 14:30:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 197/592] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:02 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd1dfae-2be0-484c-87b7-2e0474ee9287"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334219 Nov 21 14:30:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 199/593] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:30:02 2023] POST /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:12 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'services' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:30:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments/fdd1dfae-2be0-484c-87b7-2e0474ee9287" status: 202 len: 0 microversion: 2.1 time: 0.169534 Nov 21 14:30:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 198/594] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:30:11 2023] DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments/fdd1dfae-2be0-484c-87b7-2e0474ee9287 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3f92bb83-29ac-4787-8fe9-a8660c622bb8 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Nov 21 14:30:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 198/595] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:30:12 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a0375a66-53c1-47e1-95da-1dcdc7800bdf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171762 Nov 21 14:30:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 200/596] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:30:18 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-interface => generated 282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Creating event network-changed:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:30:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029170 Nov 21 14:30:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 199/597] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f00a81d1-2654-4b9d-b65a-98035bd5db20 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/ips" status: 200 len: 104 microversion: 2.1 time: 0.035053 Nov 21 14:30:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 199/598] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:30:19 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/ips => generated 104 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a599266-ce68-4b30-832f-252213f580c3"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265300 Nov 21 14:30:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 201/599] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:30:22 2023] POST /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:30:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9" status: 204 len: 0 microversion: 2.1 time: 0.117053 Nov 21 14:30:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 200/600] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:30:28 2023] DELETE /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:28 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026bd9694a247cdab93467d43b9f57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357e5035226846ffac018b95ba6a9853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3fab4238-ea46-4b05-8537-272dfe52b870 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9" status: 200 len: 1459 microversion: 2.1 time: 0.239761 Nov 21 14:30:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 200/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:28 2023] GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9 => generated 1459 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:30:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "name": "network-vif-unplugged", "status": "completed", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Creating event network-vif-unplugged:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:30:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036570 Nov 21 14:30:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 202/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "name": "network-vif-deleted", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] Creating event network-vif-deleted:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:30:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033819 Nov 21 14:30:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 201/603] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24342449-c859-4f3d-a215-4f1930a612b9", "name": "network-vif-plugged", "status": "completed", "tag": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Creating event network-vif-plugged:c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance 24342449-c859-4f3d-a215-4f1930a612b9 on user Nov 21 14:30:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039700 Nov 21 14:30:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 203/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54" status: 204 len: 0 microversion: 2.1 time: 0.267774 Nov 21 14:30:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 201/605] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:30:30 2023] DELETE /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:30 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ca5d6593-81ce-4b51-960b-21ab5c806419 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54" status: 200 len: 1490 microversion: 2.1 time: 0.234844 Nov 21 14:30:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 202/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:30 2023] GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54 => generated 1490 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:30:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-fe6246ba-546c-46f9-94d4-1475e7155169 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071970 Nov 21 14:30:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 204/607] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:30:30 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-578a29b4-2361-49ef-8c0b-fe201658bddc tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3" status: 200 len: 194 microversion: 2.1 time: 0.039534 Nov 21 14:30:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 202/608] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 21 14:30:30 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "name": "network-vif-unplugged", "status": "completed", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}, {"server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "name": "network-vif-plugged", "status": "completed", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Creating event network-vif-unplugged:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:30:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Creating event network-vif-plugged:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:30:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042001 Nov 21 14:30:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 203/609] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e790cd0-0035-41f3-bdd9-975c7d9392e1"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8982cace-751d-41d6-9131-561f6b55ca54", "name": "network-vif-deleted", "tag": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] Creating event network-vif-deleted:630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance 8982cace-751d-41d6-9131-561f6b55ca54 on user Nov 21 14:30:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Nov 21 14:30:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 203/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315695 Nov 21 14:30:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 205/611] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:30:33 2023] POST /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:34 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-85b1de32-1f5d-4178-8409-86d9341f753e tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1704 microversion: 2.1 time: 0.475659 Nov 21 14:30:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 204/612] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:33 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1704 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:34 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-69d7330c-3f81-4cbc-9239-12e3eb607d4b tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1704 microversion: 2.1 time: 0.195410 Nov 21 14:30:34 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 204/613] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:34 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1704 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5e075996-3999-44b1-b8b7-5b676fc2a080 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149257 Nov 21 14:30:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 206/614] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:30:36 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6862794e-0a01-4d78-97e8-37855fda7acd"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297092 Nov 21 14:30:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 205/615] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:30:39 2023] POST /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f00479d6-cd77-45ff-ac2a-29c80be8c49b tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045405 Nov 21 14:30:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 205/616] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:30:42 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dd8a767f-de40-4740-bec9-3425a9889626 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3" status: 200 len: 194 microversion: 2.1 time: 0.042137 Nov 21 14:30:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 207/617] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 21 14:30:42 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:42 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'services' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:30:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3" status: 202 len: 0 microversion: 2.1 time: 0.319428 Nov 21 14:30:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 206/618] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:30:42 2023] DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/4a599266-ce68-4b30-832f-252213f580c3 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1454925154", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "25c54848-a31e-4a8b-acba-2675da8ba572"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] validate_networks() for [('25c54848-a31e-4a8b-acba-2675da8ba572', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for user 7635b3029cf14950a1978282d06bc8f3 and project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:30:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:30:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.531361 Nov 21 14:30:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 206/619] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:30:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:30:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:44 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:44 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:44 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:44 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-72519165-0820-4f82-9553-f6c3ab63ef61 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 200 len: 1395 microversion: 2.87 time: 0.085063 Nov 21 14:30:44 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 208/620] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:30:44 2023] GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:30:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Creating event network-changed:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:30:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040569 Nov 21 14:30:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 207/621] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "name": "network-vif-plugged", "status": "completed", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Creating event network-vif-plugged:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:30:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031840 Nov 21 14:30:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 207/622] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:49 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'services' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:30:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/6862794e-0a01-4d78-97e8-37855fda7acd" status: 202 len: 0 microversion: 2.1 time: 0.170981 Nov 21 14:30:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 209/623] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:30:49 2023] DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments/6862794e-0a01-4d78-97e8-37855fda7acd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fa7e262e-9f58-48aa-ad08-aca7889a3877 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060122 Nov 21 14:30:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:30:49 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "name": "network-vif-plugged", "status": "completed", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Creating event network-vif-plugged:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:30:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Nov 21 14:30:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:58 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:30:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0/action" status: 200 len: 32 microversion: 2.1 time: 0.146026 Nov 21 14:30:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 210/626] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:30:58 2023] POST /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:58 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:30:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e7a20ad5-f454-452a-88c6-28de0afde2db tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 200 len: 1507 microversion: 2.1 time: 0.203013 Nov 21 14:30:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:30:58 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:30:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:30:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Creating event network-vif-unplugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:30:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037999 Nov 21 14:30:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 209/628] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:30:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:31:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029108 Nov 21 14:31:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 211/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-85fe31ef-0845-4cb9-9797-7d1349ef6f3c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064116 Nov 21 14:31:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 210/630] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:31:02 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 204 len: 0 microversion: 2.1 time: 0.152601 Nov 21 14:31:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 210/631] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:31:02 2023] DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-935ba49b-3c85-4e7f-b92b-9e4227b8e59c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.306574 Nov 21 14:31:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 212/632] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:31:02 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/os-interface => generated 282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:02 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f1d118ae-1579-4bc6-abc9-1ab2cdb127e2 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 200 len: 1666 microversion: 2.1 time: 0.414093 Nov 21 14:31:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 211/633] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:02 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 1666 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}, {"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}, {"server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "name": "network-vif-unplugged", "status": "completed", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}, {"server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "name": "network-vif-plugged", "status": "completed", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:31:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:31:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Creating event network-vif-unplugged:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:31:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Creating event network-vif-plugged:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:31:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.046692 Nov 21 14:31:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Creating event network-changed:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:31:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036618 Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 213/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-420e0383-5993-49b2-aa55-654e8df6c9e8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1429 microversion: 2.1 time: 0.205834 Nov 21 14:31:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 212/636] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:03 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1429 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Old instance type m1.tiny, new instance type m1.small {{(pid=64452) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'cores', 'ram'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting quotas for user d9f06e22265f45beb3760ea3b9338c25 and project 079d8162d1ea42ddbf31668c8a44cf73. Resources: {'cores', 'ram'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:31:04 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:31:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action" status: 202 len: 0 microversion: 2.1 time: 0.180343 Nov 21 14:31:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 212/637] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:31:03 2023] POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61339ed-84db-4f60-8d64-292749322a77", "name": "network-vif-deleted", "tag": "a2e47e55-e8fc-4acc-94b2-affe7175312f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] Creating event network-vif-deleted:a2e47e55-e8fc-4acc-94b2-affe7175312f for instance d61339ed-84db-4f60-8d64-292749322a77 on user Nov 21 14:31:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034159 Nov 21 14:31:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 213/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6bf0f2e9-df7b-4d59-ba48-6b693d079724 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1438 microversion: 2.1 time: 0.270887 Nov 21 14:31:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 214/639] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:04 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1438 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7c58007b-ac4e-406d-96f1-c84991dad141 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/9e790cd0-0035-41f3-bdd9-975c7d9392e1" status: 200 len: 194 microversion: 2.1 time: 0.044888 Nov 21 14:31:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 213/640] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 21 14:31:05 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/9e790cd0-0035-41f3-bdd9-975c7d9392e1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Creating event network-changed:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:31:05 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:31:05 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'services' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:31:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044308 Nov 21 14:31:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 215/641] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/9e790cd0-0035-41f3-bdd9-975c7d9392e1" status: 202 len: 0 microversion: 2.1 time: 0.167682 Nov 21 14:31:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 214/642] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:31:05 2023] DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments/9e790cd0-0035-41f3-bdd9-975c7d9392e1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:31:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-unplugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:07 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Creating event network-vif-unplugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:31:07 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:31:07 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043796 Nov 21 14:31:07 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 214/643] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:31:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:31:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040130 Nov 21 14:31:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 216/644] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=105,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] HTTP exception thrown: Instance 24342449-c859-4f3d-a215-4f1930a612b9 could not be found. Nov 21 14:31:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Returning 404 to user: Instance 24342449-c859-4f3d-a215-4f1930a612b9 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:31:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-25eb8a82-6456-46ff-a2d2-695f5a463f5e tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9" status: 404 len: 111 microversion: 2.1 time: 0.089295 Nov 21 14:31:18 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 215/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:18 2023] GET /compute/v2.1/servers/24342449-c859-4f3d-a215-4f1930a612b9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:31:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64452) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:31:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049976 Nov 21 14:31:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 215/646] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=38 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:31:20 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=64453) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 21 14:31:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 Nov 21 14:31:20 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 217/647] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] HTTP exception thrown: Instance 8982cace-751d-41d6-9131-561f6b55ca54 could not be found. Nov 21 14:31:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Returning 404 to user: Instance 8982cace-751d-41d6-9131-561f6b55ca54 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:31:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-0d86f47d-1d2c-41d4-b3d8-bc83a9a04a1e tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54" status: 404 len: 111 microversion: 2.1 time: 0.031274 Nov 21 14:31:21 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:21 2023] GET /compute/v2.1/servers/8982cace-751d-41d6-9131-561f6b55ca54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-321620301", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "1c3454df-506b-4b57-a1b8-7d5145019fba"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] validate_networks() for [('1c3454df-506b-4b57-a1b8-7d5145019fba', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting quotas for project a42118796db243d7a72988931f9915fc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting quotas for user a95c719f033946038ed21c53704577b1 and project a42118796db243d7a72988931f9915fc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:31:21 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:31:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.544938 Nov 21 14:31:21 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 216/649] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:31:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:31:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ad6d98dc-c9ad-431c-8e15-6546490f7026 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:21 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ad6d98dc-c9ad-431c-8e15-6546490f7026 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:21 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ad6d98dc-c9ad-431c-8e15-6546490f7026 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ad6d98dc-c9ad-431c-8e15-6546490f7026 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b" status: 200 len: 1205 microversion: 2.1 time: 0.088357 Nov 21 14:31:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 218/650] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:21 2023] GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b => generated 1205 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Creating event network-changed:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:31:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Nov 21 14:31:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 217/651] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:26 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "name": "network-vif-plugged", "status": "completed", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Creating event network-vif-plugged:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:31:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042591 Nov 21 14:31:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 217/652] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "name": "network-vif-plugged", "status": "completed", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Creating event network-vif-plugged:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:31:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038701 Nov 21 14:31:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 219/653] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5166cb89-784d-43e5-9a2e-dae2100a6478 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078610 Nov 21 14:31:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 218/654] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:31:29 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-97aac9a0-b61f-4c40-ba05-58c8ffcea8fe tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043491 Nov 21 14:31:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 218/655] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:31:29 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:29 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:31:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 204 len: 0 microversion: 2.1 time: 0.161409 Nov 21 14:31:29 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 220/656] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:31:29 2023] DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:29 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "name": "network-vif-unplugged", "status": "completed", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Creating event network-vif-unplugged:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:31:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035336 Nov 21 14:31:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 219/657] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:30 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-487ca222-9121-4004-bba8-98474c5bccdb tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 200 len: 1660 microversion: 2.1 time: 0.299098 Nov 21 14:31:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 219/658] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:29 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 1660 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "name": "network-vif-plugged", "status": "completed", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}, {"server_uuid": "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1", "name": "network-vif-deleted", "tag": "b08c806e-bd8a-4ff2-9e57-7e282ee74121"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:32 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Creating event network-vif-plugged:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:31:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Creating event network-vif-deleted:b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 on user Nov 21 14:31:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063776 Nov 21 14:31:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 221/659] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:31:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 204 len: 0 microversion: 2.1 time: 0.145942 Nov 21 14:31:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 220/660] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:31:34 2023] DELETE /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:35 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:35 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:35 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-705083d5-f1c4-4819-87fa-77381e0377eb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 200 len: 1691 microversion: 2.87 time: 0.337575 Nov 21 14:31:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 220/661] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:31:34 2023] GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 14:31:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bfcf7884-c7b4-4ef1-ad33-7303d8c2b689 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 200 len: 1710 microversion: 2.1 time: 0.345058 Nov 21 14:31:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 222/662] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:34 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 1710 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:31:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-unplugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Creating event network-vif-unplugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:31:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034708 Nov 21 14:31:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 221/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-deleted", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] Creating event network-vif-deleted:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:31:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Nov 21 14:31:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 221/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0", "name": "network-vif-plugged", "status": "completed", "tag": "23e1e132-07a0-4650-9032-872a2dfeafb4"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:31:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Creating event network-vif-plugged:23e1e132-07a0-4650-9032-872a2dfeafb4 for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 on user Nov 21 14:31:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034149 Nov 21 14:31:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 223/665] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a52ab4df-b6a3-4222-947d-bc7b12c944e4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046917 Nov 21 14:31:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 222/666] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:31:39 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=24 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:49 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-1ac5b752-4a72-4e02-9710-7d433f151ea6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 200 len: 1487 microversion: 2.1 time: 0.265141 Nov 21 14:31:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 222/667] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:48 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 1487 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. Nov 21 14:31:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:31:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6549d5a3-8b9b-4f85-8999-f54d72ba1de9 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 404 len: 111 microversion: 2.1 time: 0.373214 Nov 21 14:31:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 224/668] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:52 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 111 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:31:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-02b090c3-9756-4203-be81-36a3e02de5a6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '.version_select at 0x7f76b13b8c10>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:53 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:53 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:31:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-02b090c3-9756-4203-be81-36a3e02de5a6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-740459586" status: 202 len: 0 microversion: 2.1 time: 0.028288 Nov 21 14:31:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 223/669] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:31:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-740459586 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:54 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:31:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0a3118d4-43ac-4955-a195-d209e43f7154 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1556 microversion: 2.1 time: 0.358104 Nov 21 14:31:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 223/670] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:54 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1556 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. Nov 21 14:31:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:31:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-753b8563-6ced-4085-a0bc-5a817e93b2c7 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 404 len: 111 microversion: 2.1 time: 0.044138 Nov 21 14:31:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 225/671] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:31:57 2023] DELETE /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:31:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. Nov 21 14:31:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:31:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9c8479ed-c1c3-4676-96c4-d872ede6376d tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77" status: 404 len: 111 microversion: 2.1 time: 0.048030 Nov 21 14:31:57 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 224/672] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:31:57 2023] GET /compute/v2.1/servers/d61339ed-84db-4f60-8d64-292749322a77 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. Nov 21 14:32:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0ee8974f-9192-493b-b4dc-1caf36d0e53e tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 404 len: 111 microversion: 2.1 time: 0.030418 Nov 21 14:32:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 224/673] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:01 2023] DELETE /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. Nov 21 14:32:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance a76d5dda-a6c7-4e62-8471-16c8c99344da could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7036ae99-4bb7-44f6-8610-9511c6df133c tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da" status: 404 len: 111 microversion: 2.1 time: 0.034497 Nov 21 14:32:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 226/674] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:01 2023] GET /compute/v2.1/servers/a76d5dda-a6c7-4e62-8471-16c8c99344da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. Nov 21 14:32:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-586b4e8b-4507-4ee3-baae-3cfb367bcfeb tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 404 len: 111 microversion: 2.1 time: 0.033033 Nov 21 14:32:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 225/675] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:01 2023] DELETE /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. Nov 21 14:32:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-4b524468-827c-4dd0-9a75-86ddae0c337b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12" status: 404 len: 111 microversion: 2.1 time: 0.028838 Nov 21 14:32:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 225/676] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:02 2023] GET /compute/v2.1/servers/898bb3eb-39ce-4476-84b9-eb258eccbd12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:32:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 204 len: 0 microversion: 2.1 time: 0.156948 Nov 21 14:32:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 227/677] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:03 2023] DELETE /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "name": "network-vif-unplugged", "status": "completed", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:32:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Creating event network-vif-unplugged:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:32:04 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ba98964518472c872e959c17ca4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391e0d9d2d344d06a315a6bbea613404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037771 Nov 21 14:32:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 226/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-48c59677-b8df-4aca-85a5-aec3a9b5cb0f tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 200 len: 1719 microversion: 2.1 time: 0.306723 Nov 21 14:32:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 226/679] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:04 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 1719 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. Nov 21 14:32:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c6a54c93-a92c-4095-b3da-ec4853c775f6 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 404 len: 111 microversion: 2.1 time: 0.039323 Nov 21 14:32:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 228/680] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:05 2023] DELETE /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HTTP exception thrown: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. Nov 21 14:32:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Returning 404 to user: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c9056f01-5e20-4713-b54a-2ba313eb3b90 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" status: 404 len: 111 microversion: 2.1 time: 0.033449 Nov 21 14:32:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 227/681] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:05 2023] GET /compute/v2.1/servers/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "name": "network-vif-deleted", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:32:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] Creating event network-vif-deleted:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:32:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042757 Nov 21 14:32:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 227/682] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9", "name": "network-vif-plugged", "status": "completed", "tag": "2ab935fb-7141-46fd-92c0-9c10ef997044"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:32:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Creating event network-vif-plugged:2ab935fb-7141-46fd-92c0-9c10ef997044 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 on user Nov 21 14:32:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039618 Nov 21 14:32:06 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 229/683] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:12 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d266029a-1baa-4548-b9d5-e69686a67aff tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b" status: 200 len: 1484 microversion: 2.1 time: 0.206165 Nov 21 14:32:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 228/684] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:11 2023] GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b => generated 1484 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. Nov 21 14:32:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c30e4f73-e54d-4594-a456-e1408c7008a2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 404 len: 111 microversion: 2.1 time: 0.034717 Nov 21 14:32:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 228/685] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:20 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:20 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ed2b2267-e648-48ba-8063-5dde28a254f9 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '.version_select at 0x7f76b1228d30>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ed2b2267-e648-48ba-8063-5dde28a254f9 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711900749" status: 202 len: 0 microversion: 2.1 time: 0.035578 Nov 21 14:32:20 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 230/686] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:32:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711900749 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=26 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HTTP exception thrown: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. Nov 21 14:32:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Returning 404 to user: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-be75190a-06dd-46a6-a92d-ec874feb46d1 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 404 len: 111 microversion: 2.1 time: 0.041138 Nov 21 14:32:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 229/687] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:25 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HTTP exception thrown: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. Nov 21 14:32:25 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Returning 404 to user: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ffe37042-9fa5-4099-8867-1f10f5016828 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028592 Nov 21 14:32:25 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 229/688] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:32:25 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. Nov 21 14:32:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6d0b5234-af84-4bce-afde-d86a529a7ab1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 404 len: 111 microversion: 2.1 time: 0.029617 Nov 21 14:32:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 231/689] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:27 2023] DELETE /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. Nov 21 14:32:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-71589fea-91ea-448d-846a-52d29f9987d1 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" status: 404 len: 111 microversion: 2.1 time: 0.044179 Nov 21 14:32:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:27 2023] GET /compute/v2.1/servers/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HTTP exception thrown: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. Nov 21 14:32:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Returning 404 to user: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3444fdd1-5779-442e-99b9-a24a7756c994 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 404 len: 111 microversion: 2.1 time: 0.030356 Nov 21 14:32:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 230/691] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:28 2023] DELETE /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HTTP exception thrown: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. Nov 21 14:32:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Returning 404 to user: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3f079de8-370c-4274-bb94-a761c5ab73b7 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" status: 404 len: 111 microversion: 2.1 time: 0.029329 Nov 21 14:32:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 232/692] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:28 2023] GET /compute/v2.1/servers/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9d981262-b070-4f33-9eac-5e0e11bf641a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Calling method '.version_select at 0x7f76b11c6cb0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9d981262-b070-4f33-9eac-5e0e11bf641a tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155942104" status: 202 len: 0 microversion: 2.1 time: 0.022645 Nov 21 14:32:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 231/693] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:32:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155942104 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. Nov 21 14:32:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-91443059-baca-4ada-8f68-293ac97ff6d7 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 404 len: 111 microversion: 2.1 time: 0.031764 Nov 21 14:32:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 231/694] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:32:34 2023] DELETE /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HTTP exception thrown: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. Nov 21 14:32:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Returning 404 to user: Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-448d945b-3fc5-4fc5-b43e-a34e6c9a2abf tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113" status: 404 len: 111 microversion: 2.1 time: 0.034430 Nov 21 14:32:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 233/695] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:34 2023] GET /compute/v2.1/servers/7892830a-13fc-48a2-bfd3-29a96b2a9113 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-713412147"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842/action" status: 202 len: 52 microversion: 2.87 time: 1.095722 Nov 21 14:32:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 232/696] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:32:35 2023] POST /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842/action => generated 52 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 21 14:32:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ad554def-2ffa-4e30-afb7-a06f17103c29 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b11ac430>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ad554def-2ffa-4e30-afb7-a06f17103c29 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ffd38af5-d6ba-4044-ad26-4e06e827bd84" status: 200 len: 350 microversion: 2.1 time: 0.319544 Nov 21 14:32:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 232/697] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:32:37 2023] GET /compute/v2.1/os-volumes/ffd38af5-d6ba-4044-ad26-4e06e827bd84 => generated 350 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c4a0eefc-feb7-4da8-827c-d184968b132a tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b1229480>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c4a0eefc-feb7-4da8-827c-d184968b132a tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a43f9a94-48f2-48dc-b6fd-b1e9a22ad2e3" status: 200 len: 351 microversion: 2.1 time: 0.059895 Nov 21 14:32:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 234/698] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:32:40 2023] GET /compute/v2.1/os-volumes/a43f9a94-48f2-48dc-b6fd-b1e9a22ad2e3 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:42 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7f3ded2c-1a17-433a-a982-83b0f0722b0a tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b162b520>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:42 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7f3ded2c-1a17-433a-a982-83b0f0722b0a tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1add34d-00b9-46b8-88f4-7381962f7adb" status: 200 len: 351 microversion: 2.1 time: 0.063847 Nov 21 14:32:42 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:32:42 2023] GET /compute/v2.1/os-volumes/f1add34d-00b9-46b8-88f4-7381962f7adb => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8b210b4c-943b-422c-b155-9b869a90159c tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b0f62680>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8b210b4c-943b-422c-b155-9b869a90159c tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100918 Nov 21 14:32:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 233/700] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 21 14:32:42 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e601b276-c10a-45e4-9c53-d49528445881 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b122a290>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e601b276-c10a-45e4-9c53-d49528445881 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.104035 Nov 21 14:32:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 235/701] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a81a0911-8b3e-499c-b679-26dd7bab7d08 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b17e9120>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a81a0911-8b3e-499c-b679-26dd7bab7d08 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.117588 Nov 21 14:32:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 234/702] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a00adb3c-62b5-49ca-b663-bd5d34097ee8 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b13b89d0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a00adb3c-62b5-49ca-b663-bd5d34097ee8 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.076654 Nov 21 14:32:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 234/703] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c971a5c1-2645-48aa-a2fa-7f5a0491a13c tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b1229360>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c971a5c1-2645-48aa-a2fa-7f5a0491a13c tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096099 Nov 21 14:32:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 236/704] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-14c05457-68c4-4d35-a52f-02b698abf18d tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b12d3d00>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-14c05457-68c4-4d35-a52f-02b698abf18d tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082725 Nov 21 14:32:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 235/705] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-984a325d-8c50-411c-beed-d7775287c77d tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b122aa70>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-984a325d-8c50-411c-beed-d7775287c77d tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087058 Nov 21 14:32:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 237/706] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-00f70c20-1b58-4586-8d75-841b74d5ec98 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] Calling method '.version_select at 0x7f76b17e8af0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:43 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-00f70c20-1b58-4586-8d75-841b74d5ec98 tempest-VolumesTestJSON-1390356580 tempest-VolumesTestJSON-1390356580-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082649 Nov 21 14:32:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 236/707] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5e0e9d12-7b29-453c-ac50-b788dd6ccbe6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 200 len: 1691 microversion: 2.87 time: 0.251454 Nov 21 14:32:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 235/708] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:32:43 2023] GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:49 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-902fc680-caf0-42c4-93e5-613f064afb25 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1501 microversion: 2.1 time: 0.562360 Nov 21 14:32:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 238/709] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:49 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1501 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] HTTP exception thrown: Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 could not be found. Nov 21 14:32:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Returning 404 to user: Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:32:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b109aa4f-c047-4356-8abb-5e47b2d437bd tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" status: 404 len: 111 microversion: 2.1 time: 0.043598 Nov 21 14:32:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:54 2023] GET /compute/v2.1/servers/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:32:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cbef859e-281b-426b-b8fd-b872c5d361b4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Calling method '.version_select at 0x7f76b11ae9e0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:32:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cbef859e-281b-426b-b8fd-b872c5d361b4 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440997765" status: 202 len: 0 microversion: 2.1 time: 0.028116 Nov 21 14:32:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 236/711] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:32:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440997765 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action" status: 204 len: 0 microversion: 2.1 time: 0.122782 Nov 21 14:32:55 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 239/712] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:32:54 2023] POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:32:55 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:32:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-31c74557-93a3-4ad7-939b-5049d0400c8d tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1556 microversion: 2.1 time: 0.253275 Nov 21 14:32:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 238/713] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:32:55 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:33:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b" status: 204 len: 0 microversion: 2.1 time: 0.112941 Nov 21 14:33:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 237/714] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:33:12 2023] DELETE /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "name": "network-vif-unplugged", "status": "completed", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Creating event network-vif-unplugged:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:33:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037620 Nov 21 14:33:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 239/715] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:13 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f0596eb0-ff2b-4379-a225-f66604944745 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b" status: 200 len: 1490 microversion: 2.1 time: 0.453013 Nov 21 14:33:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 240/716] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:33:12 2023] GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b => generated 1490 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:33:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "name": "network-vif-deleted", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] Creating event network-vif-deleted:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:33:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212348 Nov 21 14:33:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 238/717] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4585-d3ed-425f-bdbb-b4a1e906143b", "name": "network-vif-plugged", "status": "completed", "tag": "ccd597cc-da6f-4360-b5bf-4a1a974decb8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Creating event network-vif-plugged:ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b on user Nov 21 14:33:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035128 Nov 21 14:33:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 240/718] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1731130822", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "destination_type": "volume"}], "networks": [{"uuid": "25c54848-a31e-4a8b-acba-2675da8ba572"}]}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] validate_networks() for [('25c54848-a31e-4a8b-acba-2675da8ba572', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting quotas for user 7635b3029cf14950a1978282d06bc8f3 and project 96e5113ec65d46c4b8859c4658433b02. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:33:44 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:33:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.817505 Nov 21 14:33:45 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 241/719] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:33:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:45 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:45 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7690d34e-0168-4273-8bb3-bf5d5254a6e7 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1395 microversion: 2.87 time: 0.093924 Nov 21 14:33:45 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 239/720] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:33:45 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1395 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:45 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a6f61523-4b02-44af-b25e-1b8e50045e16 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1548 microversion: 2.1 time: 0.615127 Nov 21 14:33:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 241/721] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:33:45 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1548 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:33:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-25a3c74f-1515-47b8-878b-ccc34d9cbb28 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: .version_select at 0x7f76b1229e10>, body: {"keypair": {"name": "tempest-keypair-832007284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOorQNTa6zgu29HxzWmEkoqhVpSdQf4ZfG77uGHFVBNgLTXqaCSl0pFAJ0Bq3aaAHnqpF80Pd7HIBQXQ67rIYl2dTa7CpM5rgqHaoAFffHONec18YKMUOY1lD0YzpFlI7Q=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:46 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-25a3c74f-1515-47b8-878b-ccc34d9cbb28 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for project eea6fab008a747ef9093b7c92fb27708. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:33:46 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-25a3c74f-1515-47b8-878b-ccc34d9cbb28 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for user d7ad8112276648628ce9669c2445ea81 and project eea6fab008a747ef9093b7c92fb27708. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:33:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-25a3c74f-1515-47b8-878b-ccc34d9cbb28 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057896 Nov 21 14:33:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 242/722] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:33:46 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Creating event network-changed:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:33:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 Nov 21 14:33:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 240/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1495642543", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214"}], "security_groups": [{"name": "tempest-securitygroup--102840547"}], "key_name": "tempest-keypair-832007284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] validate_networks() for [('b177e5d3-406f-4f1a-8e8a-d6f86bba8214', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for project eea6fab008a747ef9093b7c92fb27708. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for user d7ad8112276648628ce9669c2445ea81 and project eea6fab008a747ef9093b7c92fb27708. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:33:48 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:33:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.753812 Nov 21 14:33:48 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 242/724] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:33:47 2023] POST /compute/v2.1/servers => generated 403 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:33:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-67d67564-725e-4a56-b2d6-32f04d5b1a59 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-67d67564-725e-4a56-b2d6-32f04d5b1a59 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:48 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-67d67564-725e-4a56-b2d6-32f04d5b1a59 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-67d67564-725e-4a56-b2d6-32f04d5b1a59 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a" status: 200 len: 1234 microversion: 2.1 time: 0.089350 Nov 21 14:33:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 243/725] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:33:48 2023] GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:33:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Creating event network-changed:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:33:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032623 Nov 21 14:33:51 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 241/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:52 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:33:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/action" status: 200 len: 32 microversion: 2.1 time: 0.156327 Nov 21 14:33:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 243/727] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:33:52 2023] POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:33:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f4d6fd52-6d5b-4a5d-8692-475e58452064 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1507 microversion: 2.1 time: 0.347734 Nov 21 14:33:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 244/728] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:33:52 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:33:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "name": "network-vif-plugged", "status": "completed", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Creating event network-vif-plugged:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:33:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379651 Nov 21 14:33:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 242/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "name": "network-vif-plugged", "status": "completed", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}, {"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}, {"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Creating event network-vif-plugged:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:33:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Creating event network-vif-unplugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:33:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:33:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.045633 Nov 21 14:33:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 244/730] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:33:57 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:33:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}, {"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:33:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:33:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:33:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:33:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:33:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:33:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071107 Nov 21 14:33:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 245/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:02 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:34:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234492 Nov 21 14:34:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 243/732] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:34:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] HTTP exception thrown: Instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b could not be found. Nov 21 14:34:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Returning 404 to user: Instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:34:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8d709d72-cb38-4e26-83c2-4b761bf3da74 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b" status: 404 len: 111 microversion: 2.1 time: 0.197022 Nov 21 14:34:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:03 2023] GET /compute/v2.1/servers/9daf4585-d3ed-425f-bdbb-b4a1e906143b => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:34:04 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:34:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043488 Nov 21 14:34:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 246/734] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:34:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-645232623", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:22 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] validate_networks() for [('35d5d62e-2b8e-40c7-bc6a-cc2149e5109c', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Getting quotas for project f1dd4f5f58c346d396383b8ebb48c021. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Getting quotas for user ec5849af9af64b3cae0841a5393948a3 and project f1dd4f5f58c346d396383b8ebb48c021. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:34:23 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:34:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.803145 Nov 21 14:34:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 244/735] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:34:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:34:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-db91ee71-f176-4de9-9322-90725f32a26a tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:23 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-db91ee71-f176-4de9-9322-90725f32a26a tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:23 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:23 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:23 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-db91ee71-f176-4de9-9322-90725f32a26a tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5849af9af64b3cae0841a5393948a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dd4f5f58c346d396383b8ebb48c021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-db91ee71-f176-4de9-9322-90725f32a26a tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373" status: 200 len: 1205 microversion: 2.1 time: 0.077926 Nov 21 14:34:23 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 246/736] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:23 2023] GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373 => generated 1205 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Creating event network-changed:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:34:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045264 Nov 21 14:34:26 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 247/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:34:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "name": "network-vif-plugged", "status": "completed", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Creating event network-vif-plugged:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:34:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037970 Nov 21 14:34:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 245/738] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:34:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "name": "network-vif-plugged", "status": "completed", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:34 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Creating event network-vif-plugged:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:34:34 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Nov 21 14:34:34 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 247/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c2433d9a-6bf5-49f2-9232-01edced5f769 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1770 microversion: 2.87 time: 0.243039 Nov 21 14:34:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 248/740] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:34:35 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1770 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:39 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-11105fc8-3085-492e-88a1-98f7d3590082 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a" status: 200 len: 1542 microversion: 2.1 time: 0.238183 Nov 21 14:34:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 246/741] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:38 2023] GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:43 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-06406b61-22b5-4089-a246-19fa792b50bc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1487 microversion: 2.1 time: 0.373458 Nov 21 14:34:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 248/742] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:42 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1487 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:46 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bdabe7e7-f686-4d66-aeba-264bcd65bf8f tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1548 microversion: 2.1 time: 0.548304 Nov 21 14:34:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 249/743] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:46 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1548 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action" status: 200 len: 32305 microversion: 2.1 time: 0.271556 Nov 21 14:34:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 247/744] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:34:46 2023] POST /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42/action => generated 32305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:47 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-66165535-948c-453d-9bd2-3b6d8922fe90 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1539 microversion: 2.1 time: 0.261038 Nov 21 14:34:47 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 249/745] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:47 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:34:55 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-78fe83a7-e7d2-4408-a594-e39f372ff2d3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'create', calling method: .version_select at 0x7f76b131e950>, body: {"keypair": {"name": "tempest-TestStampPattern-124603786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:55 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-78fe83a7-e7d2-4408-a594-e39f372ff2d3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for project ce558a840a8c4055a42b197328a0d13a. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:34:55 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-78fe83a7-e7d2-4408-a594-e39f372ff2d3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for user eafb1966d06e4d688566d1b5af779c17 and project ce558a840a8c4055a42b197328a0d13a. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:34:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-78fe83a7-e7d2-4408-a594-e39f372ff2d3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.143635 Nov 21 14:34:55 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 250/746] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:34:55 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-744241441", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "key_name": "tempest-TestStampPattern-124603786", "security_groups": [{"name": "tempest-secgroup-smoke-1980598022"}], "networks": [{"uuid": "406f84de-7ca7-4822-a0b8-6ccad53522c0"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] validate_networks() for [('406f84de-7ca7-4822-a0b8-6ccad53522c0', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for project ce558a840a8c4055a42b197328a0d13a. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for user eafb1966d06e4d688566d1b5af779c17 and project ce558a840a8c4055a42b197328a0d13a. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:34:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:34:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.716281 Nov 21 14:34:57 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 248/747] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:34:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:34:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f906690f-fd6c-4fdc-88bc-c949f47d9196 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:34:57 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f906690f-fd6c-4fdc-88bc-c949f47d9196 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:34:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:34:58 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f906690f-fd6c-4fdc-88bc-c949f47d9196 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:34:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f906690f-fd6c-4fdc-88bc-c949f47d9196 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 200 len: 1233 microversion: 2.1 time: 0.092937 Nov 21 14:34:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 250/748] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:34:57 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Creating event network-changed:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:35:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033443 Nov 21 14:35:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 251/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "name": "network-vif-plugged", "status": "completed", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Creating event network-vif-plugged:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:35:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049039 Nov 21 14:35:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 249/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "name": "network-vif-plugged", "status": "completed", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Creating event network-vif-plugged:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:35:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030468 Nov 21 14:35:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 251/751] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:13 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5849af9af64b3cae0841a5393948a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dd4f5f58c346d396383b8ebb48c021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ad50cda9-05e2-42a0-adaa-4c485ef56050 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373" status: 200 len: 1482 microversion: 2.1 time: 0.202003 Nov 21 14:35:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 252/752] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:35:13 2023] GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373 => generated 1482 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "e5a45695-41fb-453d-bd83-e1322c4fadbc"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:35 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'flavor' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:35:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5/action" status: 200 len: 29 microversion: 2.87 time: 0.421768 Nov 21 14:35:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 250/753] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:35:35 2023] POST /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5/action => generated 29 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:36 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3c4e04af-5a54-4d5c-9942-0698424bb882 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1776 microversion: 2.87 time: 0.257248 Nov 21 14:35:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 252/754] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:35:36 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1776 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:35:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-unplugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:36 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:36 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:35:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Creating event network-vif-unplugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:35:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036435 Nov 21 14:35:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 253/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:35:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039785 Nov 21 14:35:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 251/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:39 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9d293bcd-8f24-460d-9158-10aea02f46ff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.134881 Nov 21 14:35:39 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 253/757] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:35:39 2023] GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-interface => generated 282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:40 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:40 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Creating event network-changed:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:35:40 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036769 Nov 21 14:35:40 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 254/758] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f749752e-88d4-4fa9-8487-11423d91fc39", "device": "/dev/vdb"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338431 Nov 21 14:35:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 252/759] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:35:40 2023] POST /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:35:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038717 Nov 21 14:35:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:35:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Nov 21 14:35:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 255/761] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b7ced59-2aa9-4a6a-a8f7-a8ebb7781547"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c while it is in vm_state rescued Nov 21 14:35:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Returning 409 to user: Cannot 'attach_volume' instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c while it is in vm_state rescued {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:35:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2ed0b331-9e6b-4d81-916a-c0b75b563339 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052920 Nov 21 14:35:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 253/762] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:35:43 2023] POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/action" status: 202 len: 0 microversion: 2.1 time: 0.079803 Nov 21 14:35:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 255/763] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:35:43 2023] POST /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:43 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e5df1627-9dfe-4b21-9f30-0108156a70b6 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1495 microversion: 2.1 time: 0.394974 Nov 21 14:35:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 256/764] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:35:43 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1495 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Creating event network-vif-unplugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:35:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041067 Nov 21 14:35:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 254/765] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:35:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064562 Nov 21 14:35:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 256/766] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:47 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:35:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 204 len: 0 microversion: 2.1 time: 0.170941 Nov 21 14:35:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 257/767] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:35:47 2023] DELETE /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:47 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-77b2f990-297c-447a-8f5c-945aff5791e0 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 200 len: 1554 microversion: 2.1 time: 0.254232 Nov 21 14:35:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 255/768] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:35:47 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:48 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:35:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9b6ae6d6-7a2b-46ea-8cee-3de72e85271a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 200 len: 1536 microversion: 2.1 time: 0.415912 Nov 21 14:35:48 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 257/769] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:35:48 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 1536 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:35:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-unplugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Creating event network-vif-unplugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:35:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041191 Nov 21 14:35:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 258/770] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}, {"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:35:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:35:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036117 Nov 21 14:35:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 256/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:50 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-plugged", "status": "completed", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Creating event network-vif-plugged:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:35:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037832 Nov 21 14:35:50 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 258/772] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:35:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ece97-45cb-4033-8590-e97182af0a42", "name": "network-vif-deleted", "tag": "388999f8-b374-406c-9d58-855ff9c23da8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:35:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:35:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:35:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:35:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] Creating event network-vif-deleted:388999f8-b374-406c-9d58-855ff9c23da8 for instance 9a6ece97-45cb-4033-8590-e97182af0a42 on user Nov 21 14:35:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038856 Nov 21 14:35:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 259/773] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:08 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'services' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:36:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-volume_attachments/f749752e-88d4-4fa9-8487-11423d91fc39" status: 202 len: 0 microversion: 2.1 time: 0.188657 Nov 21 14:36:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 257/774] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:36:08 2023] DELETE /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a/os-volume_attachments/f749752e-88d4-4fa9-8487-11423d91fc39 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=16 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:36:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a" status: 204 len: 0 microversion: 2.1 time: 0.129922 Nov 21 14:36:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 259/775] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:36:08 2023] DELETE /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:09 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b93a1117-3cdd-46e7-92fa-bd45d6bd1093 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a" status: 200 len: 1712 microversion: 2.1 time: 0.308205 Nov 21 14:36:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 260/776] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:09 2023] GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a => generated 1712 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:20 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:36:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373" status: 204 len: 0 microversion: 2.1 time: 0.115339 Nov 21 14:36:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 258/777] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:36:20 2023] DELETE /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:21 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5849af9af64b3cae0841a5393948a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dd4f5f58c346d396383b8ebb48c021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "name": "network-vif-unplugged", "status": "completed", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-fb88892a-37cd-46f7-a85b-437348f125e1 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373" status: 200 len: 1488 microversion: 2.1 time: 0.275784 Nov 21 14:36:21 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 260/778] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:20 2023] GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373 => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Creating event network-vif-unplugged:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:36:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038718 Nov 21 14:36:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 261/779] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "name": "network-vif-deleted", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] Creating event network-vif-deleted:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:36:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048325 Nov 21 14:36:21 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 259/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aae795d-f5f9-4285-a6cf-6e19ec668373", "name": "network-vif-plugged", "status": "completed", "tag": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Creating event network-vif-plugged:a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 on user Nov 21 14:36:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034640 Nov 21 14:36:23 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 261/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:26 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:26 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-32a685d4-ae52-4bf7-a917-dc404be0a369 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1756 microversion: 2.87 time: 0.337105 Nov 21 14:36:26 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 262/782] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:36:26 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1756 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:36:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "name": "network-vif-unplugged", "status": "completed", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Creating event network-vif-unplugged:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:36:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034146 Nov 21 14:36:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 260/783] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "name": "network-vif-plugged", "status": "completed", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}, {"server_uuid": "20630cb7-62c9-4e13-86a7-2432ed79368a", "name": "network-vif-deleted", "tag": "b71689fa-96c5-44a3-9305-2d3504cfc9a3"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Creating event network-vif-plugged:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:36:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Creating event network-vif-deleted:b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a on user Nov 21 14:36:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033057 Nov 21 14:36:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 262/784] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:33 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:34 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5a250e3b-72b0-4c2e-a457-9ed10865f1ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1501 microversion: 2.1 time: 0.198975 Nov 21 14:36:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 263/785] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:33 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HTTP exception thrown: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. Nov 21 14:36:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Returning 404 to user: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:36:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-0cd10a23-2b65-4967-b9c7-1389097ad28e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 404 len: 111 microversion: 2.1 time: 0.027842 Nov 21 14:36:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 261/786] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:37 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HTTP exception thrown: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. Nov 21 14:36:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Returning 404 to user: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:36:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dfcbb88c-9965-4114-a0fd-bdbb0aaf2a76 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 404 len: 111 microversion: 2.1 time: 0.029681 Nov 21 14:36:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 263/787] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:36:37 2023] DELETE /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HTTP exception thrown: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. Nov 21 14:36:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Returning 404 to user: Instance 9a6ece97-45cb-4033-8590-e97182af0a42 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:36:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e338ac30-411c-46f5-90ea-74174e738d4b tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42" status: 404 len: 111 microversion: 2.1 time: 0.028629 Nov 21 14:36:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 264/788] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:37 2023] GET /compute/v2.1/servers/9a6ece97-45cb-4033-8590-e97182af0a42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:36:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 204 len: 0 microversion: 2.1 time: 0.129360 Nov 21 14:36:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 262/789] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:36:41 2023] DELETE /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:41 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-91ed21f1-5f9f-474d-bfed-06a7a30f5254 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 200 len: 1545 microversion: 2.1 time: 0.260600 Nov 21 14:36:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 264/790] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:41 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 1545 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:36:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "name": "network-vif-unplugged", "status": "completed", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Creating event network-vif-unplugged:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:36:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048635 Nov 21 14:36:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 265/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "name": "network-vif-deleted", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] Creating event network-vif-deleted:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:36:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029776 Nov 21 14:36:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdeb200f-cb4f-4916-8fef-b35ff231d033", "name": "network-vif-plugged", "status": "completed", "tag": "a2969955-0235-4311-83c4-3d30b0e2ac53"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Creating event network-vif-plugged:a2969955-0235-4311-83c4-3d30b0e2ac53 for instance cdeb200f-cb4f-4916-8fef-b35ff231d033 on user Nov 21 14:36:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 Nov 21 14:36:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:48 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:36:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-37d8b111-f752-4a51-867a-c352d0b8f826 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 200 len: 1536 microversion: 2.1 time: 0.217039 Nov 21 14:36:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 266/794] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:48 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 1536 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:36:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Creating event network-changed:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:36:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 Nov 21 14:36:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 264/795] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebe16b16-d511-49f5-9111-c8387d694839"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262937 Nov 21 14:36:50 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 266/796] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:36:50 2023] POST /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=24 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:36:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] HTTP exception thrown: Instance 20630cb7-62c9-4e13-86a7-2432ed79368a could not be found. Nov 21 14:36:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Returning 404 to user: Instance 20630cb7-62c9-4e13-86a7-2432ed79368a could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:36:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3b0550a2-9c65-45e1-aa9e-6b0a788983e7 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a" status: 404 len: 111 microversion: 2.1 time: 0.033949 Nov 21 14:36:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 267/797] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:36:59 2023] GET /compute/v2.1/servers/20630cb7-62c9-4e13-86a7-2432ed79368a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:36:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b8b9992f-37ab-4528-9f7e-17028a8f84fd tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '.version_select at 0x7f76b0fa8430>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:36:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b8b9992f-37ab-4528-9f7e-17028a8f84fd tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832007284" status: 202 len: 0 microversion: 2.1 time: 0.022679 Nov 21 14:36:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 265/798] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:36:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832007284 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:01 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'services' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:37:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments/ebe16b16-d511-49f5-9111-c8387d694839" status: 202 len: 0 microversion: 2.1 time: 0.199485 Nov 21 14:37:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 267/799] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:37:00 2023] DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments/ebe16b16-d511-49f5-9111-c8387d694839 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-178b75cf-99f0-44ce-8ca1-a4de1fbf2fcd tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053293 Nov 21 14:37:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 268/800] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:37:01 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:10 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:10 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:10 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6c26f863-c8ec-44d5-80bb-9b5f88ee3894 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: .version_select at 0x7f76b0f0feb0>, body: {"keypair": {"name": "tempest-keypair-2025088500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH29VAkx9vv4ZlpeuG64I+mitrY1w90noGIG6MDOL1GQKBWXSJIUywZ+837obssmxZ7QBlOdeq9ll3dcdHy7cglp2/oFe6E8FeKZVn2m5A4+0qoRp/93rn0O9TP+toFw1g=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-6c26f863-c8ec-44d5-80bb-9b5f88ee3894 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for project eea6fab008a747ef9093b7c92fb27708. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-6c26f863-c8ec-44d5-80bb-9b5f88ee3894 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for user d7ad8112276648628ce9669c2445ea81 and project eea6fab008a747ef9093b7c92fb27708. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6c26f863-c8ec-44d5-80bb-9b5f88ee3894 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057822 Nov 21 14:37:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 266/801] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:37:10 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] HTTP exception thrown: Instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 could not be found. Nov 21 14:37:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Returning 404 to user: Instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:37:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-80385512-c5e8-48bf-8c3b-f1f4939f5a36 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373" status: 404 len: 111 microversion: 2.1 time: 0.041758 Nov 21 14:37:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:37:11 2023] GET /compute/v2.1/servers/2aae795d-f5f9-4285-a6cf-6e19ec668373 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1085701846", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214"}], "security_groups": [{"name": "tempest-securitygroup--1100653831"}], "key_name": "tempest-keypair-2025088500", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] validate_networks() for [('b177e5d3-406f-4f1a-8e8a-d6f86bba8214', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for project eea6fab008a747ef9093b7c92fb27708. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting quotas for user d7ad8112276648628ce9669c2445ea81 and project eea6fab008a747ef9093b7c92fb27708. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:37:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:37:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.673536 Nov 21 14:37:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 269/803] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:37:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:37:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3d2b0aca-5414-42ba-b7e6-5610ee525225 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3d2b0aca-5414-42ba-b7e6-5610ee525225 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:12 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-3d2b0aca-5414-42ba-b7e6-5610ee525225 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3d2b0aca-5414-42ba-b7e6-5610ee525225 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3" status: 200 len: 1235 microversion: 2.1 time: 0.061328 Nov 21 14:37:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 267/804] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:37:12 2023] GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3 => generated 1235 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:37:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Creating event network-changed:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:37:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031763 Nov 21 14:37:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 269/805] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "name": "network-vif-plugged", "status": "completed", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Creating event network-vif-plugged:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:37:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034518 Nov 21 14:37:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 270/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "name": "network-vif-plugged", "status": "completed", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Creating event network-vif-plugged:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:37:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029816 Nov 21 14:37:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 268/807] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:27 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:27 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5/action" status: 202 len: 0 microversion: 2.87 time: 0.082996 Nov 21 14:37:27 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 270/808] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:37:27 2023] POST /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:27 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-31d57cde-b92b-488a-81e8-2bf9a7f429a6 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1764 microversion: 2.87 time: 0.248552 Nov 21 14:37:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 271/809] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:37:27 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1764 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 14:37:27 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:27 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-unplugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:27 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Creating event network-vif-unplugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:37:27 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037266 Nov 21 14:37:27 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 269/810] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:37:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Nov 21 14:37:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 271/811] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HTTP exception thrown: Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 could not be found. Nov 21 14:37:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Returning 404 to user: Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:37:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3e23ce5e-a01a-4192-a2bf-95f14f29b556 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033" status: 404 len: 111 microversion: 2.1 time: 0.035204 Nov 21 14:37:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 272/812] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:37:31 2023] GET /compute/v2.1/servers/cdeb200f-cb4f-4916-8fef-b35ff231d033 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:37:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-bdf6839a-cd8b-4d6a-a58c-778a9932b2f7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Calling method '.version_select at 0x7f76b0f627a0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-bdf6839a-cd8b-4d6a-a58c-778a9932b2f7 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367225751" status: 202 len: 0 microversion: 2.1 time: 0.032220 Nov 21 14:37:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 270/813] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 14:37:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367225751 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:37:31 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}, {"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:31 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:37:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:37:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059658 Nov 21 14:37:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 272/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bfe2e37b-2c28-4d9f-b3ee-664b4b01ac4b tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: .version_select at 0x7f76b12293f0>, body: {"keypair": {"name": "tempest-keypair-1647412110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3EUcZV03Sh0eKhZjFWG/fQUZmRB6InEf01rFprKzRgYZVIElWC92bAAIdRNw1gr3K3D6aZwel0s/b2WDenRDNkeBJ3+JYjlJQkyF/m6ggGtSjbZh7XNvXlqBIjhS9WTw=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:37 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-bfe2e37b-2c28-4d9f-b3ee-664b4b01ac4b tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for project e50c445b6ade47c09380da2248cf5954. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:37 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-bfe2e37b-2c28-4d9f-b3ee-664b4b01ac4b tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for user 4b8ebb88fee544a793fd71ebeee0845f and project e50c445b6ade47c09380da2248cf5954. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:37 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bfe2e37b-2c28-4d9f-b3ee-664b4b01ac4b tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075532 Nov 21 14:37:37 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 273/815] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:37:36 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-377885678", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "758c2446-6e4b-4069-b657-f62d55115a7e"}], "security_groups": [{"name": "tempest-securitygroup--1635273369"}], "key_name": "tempest-keypair-1647412110", "user_data": "}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:39 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:39 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] validate_networks() for [('758c2446-6e4b-4069-b657-f62d55115a7e', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting quotas for user 4b8ebb88fee544a793fd71ebeee0845f and project e50c445b6ade47c09380da2248cf5954. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:37:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:37:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.189012 Nov 21 14:37:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 271/816] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:37:39 2023] POST /compute/v2.1/servers => generated 407 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:37:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-5986b15b-d56b-4387-b79a-a022bb0da0ce tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-5986b15b-d56b-4387-b79a-a022bb0da0ce tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:40 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-5986b15b-d56b-4387-b79a-a022bb0da0ce tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-5986b15b-d56b-4387-b79a-a022bb0da0ce tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1237 microversion: 2.1 time: 0.074976 Nov 21 14:37:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 273/817] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:37:40 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:37:44 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Creating event network-changed:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:37:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Nov 21 14:37:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 272/818] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d75311c6-e2b0-4974-9c11-b0f67fc71bff tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: .version_select at 0x7f76b1393010>, body: {"keypair": {"name": "tempest-keypair-682860110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNqwzkTWtb1hX9kGeFini4dr4Qww4cxq1yXUj1oAKofGkI6TECTCXonv6lH9zOXCj66y1aFuWoY9I0lVbQGymCq16jTqB4v1oS8eoj6yPpowy36aUXJmDbeRbcool7/A=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:44 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-d75311c6-e2b0-4974-9c11-b0f67fc71bff tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:44 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-d75311c6-e2b0-4974-9c11-b0f67fc71bff tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for user a0bd7642251d4e968bb108362dee3a3b and project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d75311c6-e2b0-4974-9c11-b0f67fc71bff tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.170540 Nov 21 14:37:44 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 274/819] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:37:44 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1853576747", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886"}], "security_groups": [{"name": "tempest-securitygroup--1175070629"}], "key_name": "tempest-keypair-682860110", "user_data": "}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] validate_networks() for [('1981ff0c-e14d-4f27-8ea1-facd0d2dd886', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for user a0bd7642251d4e968bb108362dee3a3b and project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:37:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:37:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:37:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Nov 21 14:37:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.681486 Nov 21 14:37:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 274/821] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:37:46 2023] POST /compute/v2.1/servers => generated 400 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:37:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:37:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-619da897-cf37-4821-8941-bb31d91481c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1273 microversion: 2.20 time: 0.165585 Nov 21 14:37:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 275/822] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:37:46 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:37:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:37:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036965 Nov 21 14:37:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 274/823] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Creating event network-changed:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:37:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038690 Nov 21 14:37:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 275/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:51 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:51 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-551fd1e4-5783-47ea-befb-22156f0daeae tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059310 Nov 21 14:37:51 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 276/825] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:37:51 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:37:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:37:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037134 Nov 21 14:37:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 275/826] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:37:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1689916378"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:37:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:37:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/action" status: 202 len: 0 microversion: 2.1 time: 0.968816 Nov 21 14:37:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 276/827] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:37:54 2023] POST /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=10 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:03 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f1404611-3dbb-4b8b-80ad-98aad9cd1aff tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3" status: 200 len: 1545 microversion: 2.1 time: 0.244495 Nov 21 14:38:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:02 2023] GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3 => generated 1545 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:38:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1746098191", "imageRef": "3f571ea2-6206-4ad2-b9fe-0a6c5862686a", "flavorRef": "1", "key_name": "tempest-TestStampPattern-124603786", "security_groups": [{"name": "tempest-secgroup-smoke-1980598022"}], "networks": [{"uuid": "406f84de-7ca7-4822-a0b8-6ccad53522c0"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:03 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] validate_networks() for [('406f84de-7ca7-4822-a0b8-6ccad53522c0', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:38:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ebfe56da-4ff8-4384-8d80-988dcd9873fc tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Action: 'create', calling method: .version_select at 0x7f76b10fb9a0>, body: {"keypair": {"name": "tempest-keypair-1230849473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PaMj3KH/QGatcwq0x+nUcN5bBnhHMcFTnS+cH5MeUvdSTZmhPdcZHh+E3loIVrYH1ccXRsi/n46ZW3DCpKPbS0mAMWfCIKqFtKhkvvQyrfqUz4nX8XYs13PYioP8weA=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ebfe56da-4ff8-4384-8d80-988dcd9873fc tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting quotas for project 9c6598be22e24ce3801f37d80c2b7c51. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:38:04 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ebfe56da-4ff8-4384-8d80-988dcd9873fc tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting quotas for user be4482694f814db8bd913d090863c1e5 and project 9c6598be22e24ce3801f37d80c2b7c51. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:38:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ebfe56da-4ff8-4384-8d80-988dcd9873fc tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229542 Nov 21 14:38:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 277/829] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:38:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for project ce558a840a8c4055a42b197328a0d13a. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting quotas for user eafb1966d06e4d688566d1b5af779c17 and project ce558a840a8c4055a42b197328a0d13a. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:38:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f571ea2-6206-4ad2-b9fe-0a6c5862686a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:38:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.613911 Nov 21 14:38:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 276/830] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:38:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:38:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-11d4c1fc-d537-403e-be61-f8ca707f1b33 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-11d4c1fc-d537-403e-be61-f8ca707f1b33 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-11d4c1fc-d537-403e-be61-f8ca707f1b33 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-11d4c1fc-d537-403e-be61-f8ca707f1b33 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 200 len: 1234 microversion: 2.1 time: 0.199947 Nov 21 14:38:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:04 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 1234 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:38:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "f8a78092-9e30-4479-a70f-0ef5046d7d9b"}], "security_groups": [{"name": "tempest-securitygroup--1526205212"}], "key_name": "tempest-keypair-1230849473", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:05 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] validate_networks() for [('f8a78092-9e30-4479-a70f-0ef5046d7d9b', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:38:05 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting quotas for project 9c6598be22e24ce3801f37d80c2b7c51. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting quotas for user be4482694f814db8bd913d090863c1e5 and project 9c6598be22e24ce3801f37d80c2b7c51. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:38:06 user devstack@n-api.service[64452]: WARNING nova.utils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-3333109 Nov 21 14:38:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:38:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.648422 Nov 21 14:38:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 278/832] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:38:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:38:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-01fd54ce-a90d-457e-afea-9a167dd6f520 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:06 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-01fd54ce-a90d-457e-afea-9a167dd6f520 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:06 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-01fd54ce-a90d-457e-afea-9a167dd6f520 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-01fd54ce-a90d-457e-afea-9a167dd6f520 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 200 len: 1249 microversion: 2.1 time: 0.063923 Nov 21 14:38:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 277/833] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:06 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 1249 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:38:08 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Creating event network-changed:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:38:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Nov 21 14:38:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 279/834] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Creating event network-changed:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:38:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061916 Nov 21 14:38:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 279/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-plugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Creating event network-vif-plugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:38:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029783 Nov 21 14:38:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 278/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "name": "network-vif-plugged", "status": "completed", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Creating event network-vif-plugged:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:38:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085562 Nov 21 14:38:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 280/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-plugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Creating event network-vif-plugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:38:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Nov 21 14:38:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 280/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "name": "network-vif-plugged", "status": "completed", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:38:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Creating event network-vif-plugged:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:38:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044555 Nov 21 14:38:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 279/839] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:17 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c182bac5-9133-4785-a64b-10b9057f3e68 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1770 microversion: 2.87 time: 0.306699 Nov 21 14:38:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 281/840] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:38:17 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1770 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=7 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:30 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-fd50ab56-0571-4887-83a1-5778f4b79828 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1551 microversion: 2.1 time: 0.211674 Nov 21 14:38:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 281/841] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:30 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:37 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-00bc2792-15e7-4492-b579-43c0d688b035 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1584 microversion: 2.20 time: 0.204855 Nov 21 14:38:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 280/842] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:38:37 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1584 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=16 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:54 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-84d612d7-7521-45e2-a194-0ed63f481c3f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 200 len: 1536 microversion: 2.1 time: 0.250597 Nov 21 14:38:54 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 282/843] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:54 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 1536 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:38:56 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:38:56 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2777515b-e2e4-41ce-b707-a6e2073f5725 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 200 len: 1574 microversion: 2.1 time: 0.304169 Nov 21 14:38:56 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 282/844] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:38:56 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 1574 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ff6fabb8-dd87-4105-9b5d-40b1049f1f8d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.275203 Nov 21 14:39:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 281/845] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:39:03 2023] GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-interface => generated 283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Creating event network-changed:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:39:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112843 Nov 21 14:39:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 283/846] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0", "device": "/dev/vdb"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482497 Nov 21 14:39:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 283/847] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:39:04 2023] POST /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:18 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:39:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 204 len: 0 microversion: 2.87 time: 0.229538 Nov 21 14:39:18 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 282/848] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:39:17 2023] DELETE /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-unplugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:18 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4f8c0981-aaa7-4dfb-9a0e-24e678c32b85 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 200 len: 1776 microversion: 2.87 time: 0.263441 Nov 21 14:39:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 284/849] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:39:18 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 1776 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:39:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Creating event network-vif-unplugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:39:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035433 Nov 21 14:39:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 284/850] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-deleted", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] Creating event network-vif-deleted:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:39:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094960 Nov 21 14:39:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 283/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:20 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4254b1-e8af-479c-9def-a84d4b0838f5", "name": "network-vif-plugged", "status": "completed", "tag": "d01918fa-7533-4b43-95ca-1baa184edfdc"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Creating event network-vif-plugged:d01918fa-7533-4b43-95ca-1baa184edfdc for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 on user Nov 21 14:39:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Nov 21 14:39:20 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 285/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:28 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'services' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:39:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-volume_attachments/9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0" status: 202 len: 0 microversion: 2.1 time: 0.237028 Nov 21 14:39:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 285/853] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:39:28 2023] DELETE /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/os-volume_attachments/9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:39:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3" status: 204 len: 0 microversion: 2.1 time: 0.114872 Nov 21 14:39:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 284/854] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:39:28 2023] DELETE /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:29 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:29 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f8930637-7bd9-4f04-be22-4c4772c80dd9 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3" status: 200 len: 1715 microversion: 2.1 time: 0.201047 Nov 21 14:39:29 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 286/855] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:39:29 2023] GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3 => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bdacd97f-4eb6-443d-9e05-1a66339da3a8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.149752 Nov 21 14:39:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 286/856] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:39:30 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-interface => generated 282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Creating event network-changed:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:39:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080772 Nov 21 14:39:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 285/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "726f2986-4d69-45b4-b2d6-89adc9c3c247"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323981 Nov 21 14:39:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 287/858] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:39:31 2023] POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-401f4cd0-b15c-43f3-a9cd-1bc903d0051a tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.133236 Nov 21 14:39:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 287/859] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:39:37 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-interface => generated 282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:39:38 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:38 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Creating event network-changed:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:39:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031045 Nov 21 14:39:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 286/860] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:38 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1236b91c-1c20-4f62-83bc-ea5c0bd75bcc tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/ips" status: 200 len: 109 microversion: 2.20 time: 0.040099 Nov 21 14:39:38 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 288/861] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 21 14:39:38 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:40 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:39:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/action" status: 200 len: 32 microversion: 2.1 time: 0.183761 Nov 21 14:39:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 288/862] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:39:40 2023] POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:41 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-acd3c8f5-6e74-4853-af67-4f2faf1153b1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1722 microversion: 2.1 time: 0.254945 Nov 21 14:39:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 287/863] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:39:41 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:41 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'flavor' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:39:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-unplugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Creating event network-vif-unplugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:39:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028676 Nov 21 14:39:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 289/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:42 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/action" status: 202 len: 0 microversion: 2.20 time: 0.992440 Nov 21 14:39:42 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 289/865] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:39:41 2023] POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/action => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:42 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-adfe2a24-ae08-4e74-80a9-450dead6b6c7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1708 microversion: 2.20 time: 0.387625 Nov 21 14:39:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 288/866] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:39:42 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1708 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:39:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-unplugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:43 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:39:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Creating event network-vif-unplugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:39:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:39:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042138 Nov 21 14:39:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 290/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:45 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:39:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:39:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075265 Nov 21 14:39:45 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 290/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Creating event network-changed:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:39:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045665 Nov 21 14:39:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 289/869] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "name": "network-vif-unplugged", "status": "completed", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Creating event network-vif-unplugged:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:39:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052955 Nov 21 14:39:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 291/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "name": "network-vif-deleted", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:52 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] Creating event network-vif-deleted:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:39:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Nov 21 14:39:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 291/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:53 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb419d-8cfd-40fd-b570-70d6afb10cb3", "name": "network-vif-plugged", "status": "completed", "tag": "35832af2-de3b-476c-959f-c053228aa8b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:53 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Creating event network-vif-plugged:35832af2-de3b-476c-959f-c053228aa8b9 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 on user Nov 21 14:39:53 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Nov 21 14:39:53 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 290/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:55 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7c20a042-4c6b-4d32-9953-de06d43360a5 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 200 len: 1536 microversion: 2.1 time: 0.231413 Nov 21 14:39:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 292/873] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:39:54 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 1536 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:39:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Creating event network-changed:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:39:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029572 Nov 21 14:39:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 292/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5775f51a-ed2a-4336-aff1-3b518275b5e3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.144406 Nov 21 14:39:56 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 291/875] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:39:56 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-interface => generated 282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09ce3d53-49a8-4d3a-8497-f846d3be0e58"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282230 Nov 21 14:39:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 293/876] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:39:56 2023] POST /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:39:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Creating event network-changed:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:39:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057278 Nov 21 14:39:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 293/877] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:57 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-63d7eb8d-1997-4efd-94ba-749a76b007b0 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 200 len: 1574 microversion: 2.1 time: 0.197648 Nov 21 14:39:57 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 292/878] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:39:57 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Searching by: {'deleted': False, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51'} {{(pid=64452) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:39:58 user devstack@n-api.service[64452]: DEBUG nova.compute.multi_cell_list [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64452) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 21 14:39:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-39976754-f492-4289-98a7-070ec38e11c3 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 356 microversion: 2.1 time: 0.206199 Nov 21 14:39:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 294/879] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 21 14:39:58 2023] GET /compute/v2.1/servers => generated 356 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a0d3248-1890-4b38-85f1-bf170f5baca2"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294289 Nov 21 14:40:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 294/880] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:40:00 2023] POST /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:06 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'services' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:40:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments/09ce3d53-49a8-4d3a-8497-f846d3be0e58" status: 202 len: 0 microversion: 2.1 time: 0.229707 Nov 21 14:40:07 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 293/881] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:40:06 2023] DELETE /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments/09ce3d53-49a8-4d3a-8497-f846d3be0e58 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:07 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:07 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dfe4a988-7e6f-4c9a-b9df-c68d12409c7a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077162 Nov 21 14:40:07 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 295/882] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:40:07 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HTTP exception thrown: Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 could not be found. Nov 21 14:40:08 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Returning 404 to user: Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:40:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-eebcd31f-f09d-49ca-96c5-8c02b39fe7a0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5" status: 404 len: 111 microversion: 2.87 time: 0.035884 Nov 21 14:40:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 295/883] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:40:08 2023] GET /compute/v2.1/servers/6b4254b1-e8af-479c-9def-a84d4b0838f5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:40:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 204 len: 0 microversion: 2.87 time: 0.133733 Nov 21 14:40:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 294/884] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:40:08 2023] DELETE /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "name": "network-vif-unplugged", "status": "completed", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Creating event network-vif-unplugged:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:40:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030157 Nov 21 14:40:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 296/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:09 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a87ad356-50b3-4ac0-9e3f-26294a4b3fe1 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 200 len: 1697 microversion: 2.87 time: 0.301025 Nov 21 14:40:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 296/886] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:40:08 2023] GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 1697 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG nova.compute.api [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-759cc97b-125e-4588-b4e5-8e093c83cb0d req-d429d5e8-0c47-4df4-b133-0db5948aed6d tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2" status: 200 len: 302 microversion: 2.89 time: 0.084154 Nov 21 14:40:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 295/887] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:40:09 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2 => generated 302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-00d2acfa-afd9-4709-8cf0-7576db0baad5 req-a0eb6dda-26cc-43a5-9449-61d69dbd4572 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2" status: 200 len: 302 microversion: 2.89 time: 0.097607 Nov 21 14:40:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 297/888] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 21 14:40:10 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2 => generated 302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "name": "network-vif-deleted", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] Creating event network-vif-deleted:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:40:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028130 Nov 21 14:40:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 296/889] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:10 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'services' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:40:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2" status: 202 len: 0 microversion: 2.1 time: 0.231443 Nov 21 14:40:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 297/890] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:40:10 2023] DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ef6f5946-8dd9-434a-bee4-141eac9034f6 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 Nov 21 14:40:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 298/891] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:40:10 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a754e62-be65-4faa-a27c-0e4f3b02c842", "name": "network-vif-plugged", "status": "completed", "tag": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Creating event network-vif-plugged:6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 on user Nov 21 14:40:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028908 Nov 21 14:40:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 297/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] HTTP exception thrown: Instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 could not be found. Nov 21 14:40:19 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Returning 404 to user: Instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:40:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a1f8754d-7237-4abb-85ec-ba78f278df47 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3" status: 404 len: 111 microversion: 2.1 time: 0.034002 Nov 21 14:40:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:40:19 2023] GET /compute/v2.1/servers/f8bb419d-8cfd-40fd-b570-70d6afb10cb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:40:19 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4c373a0f-b591-4d5a-a9c6-5bdd5c2464ad tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Calling method '.version_select at 0x7f76b122bf40>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:19 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=33 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:19 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4c373a0f-b591-4d5a-a9c6-5bdd5c2464ad tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025088500" status: 202 len: 0 microversion: 2.1 time: 0.029044 Nov 21 14:40:19 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 299/894] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:40:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025088500 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:31 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-81afb3e7-63bf-48b5-8236-3df585bd1b71 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1702 microversion: 2.1 time: 0.371395 Nov 21 14:40:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 298/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:40:31 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1702 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=30 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:33 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:33 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:33 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9e1166ea-0227-4885-9725-b1cba7a4cba9 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1649 microversion: 2.20 time: 0.212035 Nov 21 14:40:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 299/896] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:40:32 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1649 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-381523c3-7c37-4aab-a9f1-7961ae30e741 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080470 Nov 21 14:40:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 300/897] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:40:57 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:57 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Creating event network-changed:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:40:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046013 Nov 21 14:40:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 300/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:58 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:40:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 204 len: 0 microversion: 2.1 time: 0.172189 Nov 21 14:40:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 299/899] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:40:57 2023] DELETE /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0194efcc-29a0-4a4e-af3c-8b7e55cd2e23 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 200 len: 1661 microversion: 2.1 time: 0.467291 Nov 21 14:40:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 301/900] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:40:58 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 1661 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:40:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-unplugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:58 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Creating event network-vif-unplugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:40:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032215 Nov 21 14:40:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 301/901] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HTTP exception thrown: Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 could not be found. Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Returning 404 to user: Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:40:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3210c057-b236-4305-84a8-26d4e82446ab tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842" status: 404 len: 111 microversion: 2.87 time: 0.032968 Nov 21 14:40:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 300/902] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:40:59 2023] GET /compute/v2.1/servers/5a754e62-be65-4faa-a27c-0e4f3b02c842 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:40:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 204 len: 0 microversion: 2.87 time: 0.120991 Nov 21 14:40:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 302/903] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:40:59 2023] DELETE /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-deleted", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:40:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:40:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] Creating event network-vif-deleted:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:40:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046445 Nov 21 14:40:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 301/904] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:40:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:59 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:40:59 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d8b9ac2c-c982-4245-8311-cda9bde30e64 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 200 len: 1774 microversion: 2.87 time: 0.276949 Nov 21 14:40:59 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 302/905] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:40:59 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 1774 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9f5e74f8-72da-44f4-a75f-c792943cab46 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043536 Nov 21 14:41:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 303/906] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:41:00 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-plugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}, {"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-plugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}, {"server_uuid": "7842f8c8-ffe8-4944-afad-61c4a2bc017a", "name": "network-vif-plugged", "status": "completed", "tag": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Creating event network-vif-plugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:41:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Creating event network-vif-plugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:41:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Creating event network-vif-plugged:1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a on user Nov 21 14:41:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031479 Nov 21 14:41:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 303/907] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] HTTP exception thrown: Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf is not attached to volume 8a0d3248-1890-4b38-85f1-bf170f5baca2 Nov 21 14:41:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Returning 404 to user: Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf is not attached to volume 8a0d3248-1890-4b38-85f1-bf170f5baca2 {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-0f9627d0-d4e8-4b70-9803-fb481c7436af tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2" status: 404 len: 154 microversion: 2.1 time: 0.111793 Nov 21 14:41:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 302/908] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:41:00 2023] DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/os-volume_attachments/8a0d3248-1890-4b38-85f1-bf170f5baca2 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:41:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-unplugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}, {"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-plugged", "status": "completed", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}, {"server_uuid": "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44", "name": "network-vif-deleted", "tag": "2af316c0-8063-431b-b1a8-cdb069de9c03"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Creating event network-vif-unplugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:41:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Creating event network-vif-plugged:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:41:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Creating event network-vif-deleted:2af316c0-8063-431b-b1a8-cdb069de9c03 for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 on user Nov 21 14:41:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.052329 Nov 21 14:41:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 304/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:01 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:41:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 204 len: 0 microversion: 2.1 time: 0.138027 Nov 21 14:41:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 304/910] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:41:04 2023] DELETE /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "name": "network-vif-unplugged", "status": "completed", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:04 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-85693ffa-756d-4883-a24d-ca2eec287299 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 200 len: 1699 microversion: 2.1 time: 0.225681 Nov 21 14:41:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 303/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:41:04 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 1699 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:41:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Creating event network-vif-unplugged:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:41:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118745 Nov 21 14:41:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 305/912] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "name": "network-vif-plugged", "status": "completed", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}, {"server_uuid": "e5c578a4-87f5-4c67-af63-c9ac43b64ddf", "name": "network-vif-deleted", "tag": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Creating event network-vif-plugged:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:41:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Creating event network-vif-deleted:59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf on user Nov 21 14:41:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031739 Nov 21 14:41:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 305/913] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 while it is in vm_state rescued Nov 21 14:41:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Returning 409 to user: Cannot 'detach_volume' instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 while it is in vm_state rescued {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5e04fb19-dd34-4ec9-a696-8fb2a679dc3c tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments/726f2986-4d69-45b4-b2d6-89adc9c3c247" status: 409 len: 152 microversion: 2.1 time: 0.098488 Nov 21 14:41:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 304/914] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:41:31 2023] DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments/726f2986-4d69-45b4-b2d6-89adc9c3c247 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/action" status: 202 len: 0 microversion: 2.1 time: 0.082078 Nov 21 14:41:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 306/915] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:41:32 2023] POST /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a3fabcce-5a3a-4eef-9761-f4340400acf0 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1710 microversion: 2.1 time: 0.246174 Nov 21 14:41:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 306/916] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:41:32 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1710 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:41:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-unplugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Creating event network-vif-unplugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028499 Nov 21 14:41:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 305/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8b205839-eac8-424c-9523-cf1d180ed2fa tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297213 Nov 21 14:41:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 307/918] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 21 14:41:33 2023] POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64452) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 21 14:41:33 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/action" status: 202 len: 0 microversion: 2.20 time: 0.133588 Nov 21 14:41:33 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 307/919] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:41:33 2023] POST /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:33 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:33 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4a7df54c-41ed-40c3-afd3-a764d89b93e3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1735 microversion: 2.20 time: 0.241283 Nov 21 14:41:33 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 306/920] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:41:33 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:41:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-unplugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Creating event network-vif-unplugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038783 Nov 21 14:41:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 308/921] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:34 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:41:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033443 Nov 21 14:41:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 308/922] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:42 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:42 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Creating event network-changed:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:41:42 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033008 Nov 21 14:41:42 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 307/923] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] HTTP exception thrown: Instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a could not be found. Nov 21 14:41:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Returning 404 to user: Instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-283f838d-f6db-4c55-9b57-eb2bbd3805bf tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a" status: 404 len: 111 microversion: 2.1 time: 0.046602 Nov 21 14:41:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 309/924] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:41:48 2023] GET /compute/v2.1/servers/7842f8c8-ffe8-4944-afad-61c4a2bc017a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HTTP exception thrown: Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 could not be found. Nov 21 14:41:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Returning 404 to user: Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8acab6dd-96e3-496d-997b-258356e591c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" status: 404 len: 111 microversion: 2.87 time: 0.057112 Nov 21 14:41:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 309/925] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:41:49 2023] GET /compute/v2.1/servers/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:50 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:41:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 204 len: 0 microversion: 2.87 time: 0.136503 Nov 21 14:41:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 308/926] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:41:50 2023] DELETE /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:50 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:50 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "name": "network-vif-unplugged", "status": "completed", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d40eb75a-8ee7-420e-9acb-3a22680f8734 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 200 len: 1697 microversion: 2.87 time: 0.290211 Nov 21 14:41:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 310/927] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:41:50 2023] GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 14:41:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:50 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Creating event network-vif-unplugged:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:41:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076299 Nov 21 14:41:50 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 310/928] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "name": "network-vif-plugged", "status": "completed", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}, {"server_uuid": "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968", "name": "network-vif-deleted", "tag": "feb7f672-16b6-449a-8b69-5b3ef5573e1c"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Creating event network-vif-plugged:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:41:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:41:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Creating event network-vif-deleted:feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 on user Nov 21 14:41:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:41:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054854 Nov 21 14:41:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 309/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] HTTP exception thrown: Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf could not be found. Nov 21 14:41:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Returning 404 to user: Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:54 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-34db939f-82cb-4c73-bd0e-48ed1ae4f58a tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf" status: 404 len: 111 microversion: 2.1 time: 0.032437 Nov 21 14:41:54 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:41:54 2023] GET /compute/v2.1/servers/e5c578a4-87f5-4c67-af63-c9ac43b64ddf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 14:41:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9fbc7132-6f59-4f3c-a7ae-7383fca19d45 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Calling method '.version_select at 0x7f76b17e8c10>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9fbc7132-6f59-4f3c-a7ae-7383fca19d45 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230849473" status: 202 len: 0 microversion: 2.1 time: 0.022614 Nov 21 14:41:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 311/931] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:41:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230849473 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] HTTP exception thrown: Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff is not attached to volume ebe16b16-d511-49f5-9111-c8387d694839 Nov 21 14:41:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Returning 404 to user: Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff is not attached to volume ebe16b16-d511-49f5-9111-c8387d694839 {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:41:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fdca7f5c-9a95-41f1-9372-01e3759637ed tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments/ebe16b16-d511-49f5-9111-c8387d694839" status: 404 len: 154 microversion: 2.1 time: 0.103085 Nov 21 14:41:55 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 310/932] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:41:55 2023] DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/os-volume_attachments/ebe16b16-d511-49f5-9111-c8387d694839 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:41:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Creating event network-changed:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:41:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048196 Nov 21 14:41:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 312/933] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 204 len: 0 microversion: 2.1 time: 0.234370 Nov 21 14:41:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 312/934] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:41:57 2023] DELETE /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "name": "network-vif-unplugged", "status": "completed", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:57 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Creating event network-vif-unplugged:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:41:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035850 Nov 21 14:41:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 313/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:41:58 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:41:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-0dd8433e-6540-4c43-a529-ef14144e2358 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 200 len: 1660 microversion: 2.1 time: 0.621645 Nov 21 14:41:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 311/936] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:41:57 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 1660 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:41:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "name": "network-vif-deleted", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:41:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:41:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:41:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:41:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] Creating event network-vif-deleted:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:41:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037748 Nov 21 14:41:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 313/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:41:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:42:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff", "name": "network-vif-plugged", "status": "completed", "tag": "2173b2c8-e047-4709-ab98-0e5f6d077f8c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Creating event network-vif-plugged:2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff on user Nov 21 14:42:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Nov 21 14:42:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 314/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:42:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:22 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:42:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e86e7527-4e03-4aa4-8d09-a3cfe53aa7ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1716 microversion: 2.1 time: 0.220652 Nov 21 14:42:22 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 312/939] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:42:22 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1716 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:24 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:42:24 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:42:24 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:42:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-63b3da18-4d41-40c8-b2f7-6e7a9696b0ee tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1780 microversion: 2.20 time: 0.256964 Nov 21 14:42:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 314/940] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:42:23 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1780 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HTTP exception thrown: Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 could not be found. Nov 21 14:42:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Returning 404 to user: Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:42:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-e311b9c6-0aac-4df2-a0dc-d01106f37f77 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" status: 404 len: 111 microversion: 2.87 time: 0.032638 Nov 21 14:42:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 315/941] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:42:40 2023] GET /compute/v2.1/servers/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] HTTP exception thrown: Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff could not be found. Nov 21 14:42:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Returning 404 to user: Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:42:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-047ee8d0-9e7b-4e59-918a-4432d4346589 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" status: 404 len: 111 microversion: 2.1 time: 0.042646 Nov 21 14:42:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 313/942] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:42:48 2023] GET /compute/v2.1/servers/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:42:50 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2f9951f8-d2a1-4747-9413-8567cb28a8f0 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'create', calling method: .version_select at 0x7f76b17deef0>, body: {"keypair": {"name": "tempest-keypair-1394726022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHNmtipo1wU5OMs2w2xiTJOR6qMSY/j0Cp9ebE0YDGN2Tt3kxaT2nhewhyeEiRj0ugTAPd8QBkOGXJIMLvcE7YmsWU9Xk4fM78Vj52XJL9sQFqG1gb6MIB0acIEKHcZg=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:50 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:50 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:50 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2f9951f8-d2a1-4747-9413-8567cb28a8f0 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting quotas for project c35cfaa913094e829acc68857bba4d55. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:42:50 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2f9951f8-d2a1-4747-9413-8567cb28a8f0 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting quotas for user b6dc4469b07049be829644dfecf5745e and project c35cfaa913094e829acc68857bba4d55. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:42:50 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2f9951f8-d2a1-4747-9413-8567cb28a8f0 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060862 Nov 21 14:42:50 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 315/943] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:42:50 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:42:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9615bd56-c7c7-416b-b951-02a8906487d6 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Calling method '.version_select at 0x7f76b0fddf30>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:51 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:51 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:42:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9615bd56-c7c7-416b-b951-02a8906487d6 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-124603786" status: 202 len: 0 microversion: 2.1 time: 0.026896 Nov 21 14:42:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 316/944] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:42:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-124603786 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:42:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-133109328", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "networks": [{"uuid": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d"}], "security_groups": [{"name": "tempest-securitygroup--2121513873"}], "key_name": "tempest-keypair-1394726022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] validate_networks() for [('e69e1d79-189d-4a6c-8f13-8ae9ca73e20d', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting quotas for project c35cfaa913094e829acc68857bba4d55. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting quotas for user b6dc4469b07049be829644dfecf5745e and project c35cfaa913094e829acc68857bba4d55. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:42:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:42:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.733963 Nov 21 14:42:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 314/945] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:42:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:42:52 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b6a5c496-6763-4be4-a327-1fb97867fb48 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:42:52 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b6a5c496-6763-4be4-a327-1fb97867fb48 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:42:52 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-b6a5c496-6763-4be4-a327-1fb97867fb48 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:42:52 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b6a5c496-6763-4be4-a327-1fb97867fb48 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1237 microversion: 2.1 time: 0.085690 Nov 21 14:42:52 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 316/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:42:52 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:42:54 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:54 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Creating event network-changed:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:42:54 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027119 Nov 21 14:42:54 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 317/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:42:57 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:57 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:42:57 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042645 Nov 21 14:42:57 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 315/948] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:42:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:42:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:42:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:42:59 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:42:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:42:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Nov 21 14:42:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 317/949] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:42:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:22 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8dd0d310-9741-4297-ac47-54205f67d94d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.146913 Nov 21 14:43:22 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 318/950] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:43:22 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Creating event network-changed:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:43:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045111 Nov 21 14:43:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 316/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'services' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:43:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments/726f2986-4d69-45b4-b2d6-89adc9c3c247" status: 202 len: 0 microversion: 2.1 time: 0.429959 Nov 21 14:43:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 318/952] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:43:23 2023] DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments/726f2986-4d69-45b4-b2d6-89adc9c3c247 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b4aabecc-d5c7-4770-9301-7a059971b0e7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Nov 21 14:43:24 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:43:24 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-bf3385e9-777a-44c1-ac11-3fe816e5fa21 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments/a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d" status: 200 len: 194 microversion: 2.20 time: 0.150903 Nov 21 14:43:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 317/954] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 21 14:43:24 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments/a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'services' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:43:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments/a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d" status: 202 len: 0 microversion: 2.20 time: 0.163208 Nov 21 14:43:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 319/955] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 21 14:43:24 2023] DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments/a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f05ff07a-45c4-42e8-80cd-236f341f87c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043360 Nov 21 14:43:24 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 320/956] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 21 14:43:24 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:43:25 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:43:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Creating event network-changed:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:43:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028358 Nov 21 14:43:25 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 318/957] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:43:42 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:43:43 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:43:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f3129087-933d-4621-b303-319bce21f2e1 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1552 microversion: 2.1 time: 0.361400 Nov 21 14:43:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 320/958] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:43:42 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1552 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=16 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-767c1450-688a-48ea-a25e-1fc19e9cfc4f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051544 Nov 21 14:44:14 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 321/959] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:44:14 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:44:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 204 len: 0 microversion: 2.1 time: 0.121505 Nov 21 14:44:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 319/960] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:44:14 2023] DELETE /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-unplugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Creating event network-vif-unplugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:44:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032405 Nov 21 14:44:14 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:44:14 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:44:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c55c6a0e-11b7-437b-a31c-1a37fd4ee523 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 200 len: 1676 microversion: 2.1 time: 0.287344 Nov 21 14:44:14 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 321/962] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:44:14 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e550df3a-dba4-427f-95d4-5d95b27f415c tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043086 Nov 21 14:44:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 320/963] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 21 14:44:14 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:15 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:44:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 204 len: 0 microversion: 2.20 time: 0.106045 Nov 21 14:44:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 323/964] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:44:15 2023] DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:44:15 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:44:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d89a47ee-d948-4a9f-95a1-fd247bd179c3 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 200 len: 1708 microversion: 2.20 time: 0.251347 Nov 21 14:44:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 322/965] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:44:15 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:44:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-plugged", "status": "completed", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-unplugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}, {"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}, {"server_uuid": "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170", "name": "network-vif-deleted", "tag": "22839d58-d656-40f7-8fe3-277e0e4d0c46"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:44:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c", "name": "network-vif-deleted", "tag": "f04d9285-6760-4f9d-bfdf-e8187db846d5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:44:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Creating event network-vif-plugged:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:44:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Creating event network-vif-unplugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:44:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Creating event network-vif-plugged:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:44:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Creating event network-vif-deleted:22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 on user Nov 21 14:44:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.051470 Nov 21 14:44:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 321/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:44:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] Creating event network-vif-deleted:f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c on user Nov 21 14:44:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027038 Nov 21 14:44:16 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-44281f92-a132-4064-83f6-11ecf1bff278 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.150124 Nov 21 14:44:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 323/968] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:44:43 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-interface => generated 283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:44:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:43 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:44 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:44:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:44 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Creating event network-changed:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:44:44 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105779 Nov 21 14:44:44 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 322/969] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1882168187"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:44:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:44:45 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action" status: 202 len: 0 microversion: 2.1 time: 0.926398 Nov 21 14:44:45 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 325/970] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:44:44 2023] POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 21 14:44:45 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b7d77e37-d3b4-4110-98eb-a26602e7899b tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '.version_select at 0x7f76b17deef0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:44:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b7d77e37-d3b4-4110-98eb-a26602e7899b tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e" status: 200 len: 1609 microversion: 2.1 time: 0.059250 Nov 21 14:44:45 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 324/971] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 21 14:44:45 2023] GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e => generated 1609 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HTTP exception thrown: Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 could not be found. Nov 21 14:45:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Returning 404 to user: Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:45:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7763515d-15e1-4fe0-84db-422210e2a7a7 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" status: 404 len: 111 microversion: 2.1 time: 0.034113 Nov 21 14:45:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 323/972] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:45:04 2023] GET /compute/v2.1/servers/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:45:05 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:05 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2dd97121-8cd8-4162-9fbb-add9b9826855 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '.version_select at 0x7f76b162b250>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2dd97121-8cd8-4162-9fbb-add9b9826855 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647412110" status: 202 len: 0 microversion: 2.1 time: 0.030271 Nov 21 14:45:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 326/973] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:45:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647412110 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. Nov 21 14:45:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:45:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-8d8a5e22-86a5-4c02-9492-ed55c9140a23 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 404 len: 111 microversion: 2.20 time: 0.087268 Nov 21 14:45:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 325/974] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:45:05 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:45:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9790b914-84cf-419b-a9ab-e969488567e2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '.version_select at 0x7f76b0fab9a0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9790b914-84cf-419b-a9ab-e969488567e2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682860110" status: 204 len: 0 microversion: 2.20 time: 0.025015 Nov 21 14:45:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 324/975] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 21 14:45:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682860110 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:45:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-fcaf55b8-eca4-4985-8d9e-a4ea0d2039a6 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: .version_select at 0x7f76b17e9120>, body: {"keypair": {"name": "tempest-keypair-1578555145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWSWM7hKRLSDhHNLt8+WbBMqDCHWTKHdi/qT5EvjhUmMORwEUFq8yP0AXHv5t4D2CKrfo4oSwn7TwNq1eJ0+LVIeelZCR9xZsBuHTuZi19lUSNdrfgNSdbgCudlVnYvrw=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:06 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-fcaf55b8-eca4-4985-8d9e-a4ea0d2039a6 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:45:06 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-fcaf55b8-eca4-4985-8d9e-a4ea0d2039a6 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for user a0bd7642251d4e968bb108362dee3a3b and project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:45:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-fcaf55b8-eca4-4985-8d9e-a4ea0d2039a6 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048139 Nov 21 14:45:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 327/976] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 21 14:45:06 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 21 14:45:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-744304248", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886"}], "security_groups": [{"name": "tempest-securitygroup--776721956"}], "key_name": "tempest-keypair-1578555145", "user_data": "}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:07 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] validate_networks() for [('1981ff0c-e14d-4f27-8ea1-facd0d2dd886', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting quotas for user a0bd7642251d4e968bb108362dee3a3b and project 47eba7494a3b42929f2007ff8162d9bb. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:45:08 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:45:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.713971 Nov 21 14:45:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 326/977] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 21 14:45:07 2023] POST /compute/v2.1/servers => generated 399 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 21 14:45:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5eb3ff6e-e368-4bd4-a6bf-ced5cf4815b4 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1273 microversion: 2.20 time: 0.079897 Nov 21 14:45:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 325/978] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:45:08 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:45:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Creating event network-changed:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:45:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086792 Nov 21 14:45:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 328/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:45:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 204 len: 0 microversion: 2.1 time: 0.144242 Nov 21 14:45:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 327/980] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:45:12 2023] DELETE /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:12 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a1489b3f-f300-4fae-b7c5-7a3c2d9e3802 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 200 len: 1493 microversion: 2.1 time: 0.234020 Nov 21 14:45:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 326/981] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:45:12 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 1493 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:45:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:45:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028137 Nov 21 14:45:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 329/982] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:45:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}, {"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-plugged", "status": "completed", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:13 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Creating event network-vif-unplugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:45:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Creating event network-vif-plugged:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:45:13 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047609 Nov 21 14:45:13 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 328/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:45:15 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:15 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:45:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Nov 21 14:45:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 327/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:45:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf25b5a-9531-4058-8e86-372fef1517e0", "name": "network-vif-deleted", "tag": "2076301e-56e7-4d67-90db-192335b0f56c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:45:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] Creating event network-vif-deleted:2076301e-56e7-4d67-90db-192335b0f56c for instance ebf25b5a-9531-4058-8e86-372fef1517e0 on user Nov 21 14:45:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029658 Nov 21 14:45:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 330/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:45:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2ba13540-9ce8-4cc4-ab25-c908034c1f34 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '.version_select at 0x7f76b17dfb50>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2ba13540-9ce8-4cc4-ab25-c908034c1f34 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e" status: 200 len: 1723 microversion: 2.1 time: 0.058939 Nov 21 14:45:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 329/986] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 21 14:45:35 2023] GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e => generated 1723 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:45:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2eedff6e-9427-4ec7-88d0-24223f6ac971 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '.version_select at 0x7f76b0ff3760>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:35 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2eedff6e-9427-4ec7-88d0-24223f6ac971 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e" status: 200 len: 1723 microversion: 2.1 time: 0.058619 Nov 21 14:45:35 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 328/987] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 21 14:45:35 2023] GET /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e => generated 1723 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:35 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-123e2f2b-220d-411e-b383-9931a51fcd72 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1671 microversion: 2.1 time: 0.218989 Nov 21 14:45:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 331/988] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:45:35 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:58 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:45:58 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6c27f7ad-2435-408b-9edb-ad5c8885cf54 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1583 microversion: 2.20 time: 0.268158 Nov 21 14:45:58 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 330/989] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:45:58 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1583 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HTTP exception thrown: Instance ebf25b5a-9531-4058-8e86-372fef1517e0 could not be found. Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Returning 404 to user: Instance ebf25b5a-9531-4058-8e86-372fef1517e0 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:46:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7989c4ed-dff0-4bb6-ab8c-0ccdc9031128 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0" status: 404 len: 111 microversion: 2.1 time: 0.153107 Nov 21 14:46:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 329/990] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:46:02 2023] GET /compute/v2.1/servers/ebf25b5a-9531-4058-8e86-372fef1517e0 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:46:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 204 len: 0 microversion: 2.1 time: 0.118212 Nov 21 14:46:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 332/991] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:46:03 2023] DELETE /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:46:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dc0b6ff3-0165-40e1-8078-1d1921d7afdc tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 200 len: 1507 microversion: 2.1 time: 0.231460 Nov 21 14:46:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 331/992] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:46:03 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Creating event network-vif-unplugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:46:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028290 Nov 21 14:46:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 330/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-deleted", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] Creating event network-vif-deleted:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:46:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027541 Nov 21 14:46:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 333/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ecb76-9606-4119-a5e6-53fe33413b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1e015b80-8ab0-446f-aebd-541aaae71b0f"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Creating event network-vif-plugged:1e015b80-8ab0-446f-aebd-541aaae71b0f for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c on user Nov 21 14:46:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085123 Nov 21 14:46:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 332/995] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:35 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:36 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:46:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b58be305-f254-4efe-8fc5-d9496a97f572 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1671 microversion: 2.1 time: 0.211666 Nov 21 14:46:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 331/996] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:46:35 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1671 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d5fbba4-7b74-466e-a418-04fc7576669e"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288694 Nov 21 14:46:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 334/997] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:46:36 2023] POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=14 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fe09c065-b11f-42ae-8da0-38f1328ac27e"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:45 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'flavor' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:46:45 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action" status: 200 len: 29 microversion: 2.1 time: 0.205552 Nov 21 14:46:45 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 333/998] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:46:45 2023] POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action => generated 29 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:45 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:46:45 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-096f7f3a-ca06-47ab-8df8-16cfcac57325 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1723 microversion: 2.1 time: 0.191257 Nov 21 14:46:45 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 332/999] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:46:45 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:46:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-unplugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Creating event network-vif-unplugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:46:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029325 Nov 21 14:46:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 335/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:46:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Nov 21 14:46:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 334/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:46:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041984 Nov 21 14:46:51 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 333/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:53 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:53 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:46:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Nov 21 14:46:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 336/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HTTP exception thrown: Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c could not be found. Nov 21 14:46:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Returning 404 to user: Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:46:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-9f42895c-fc87-4268-990f-785eb2083a69 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c" status: 404 len: 111 microversion: 2.1 time: 0.033399 Nov 21 14:46:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 335/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:46:53 2023] GET /compute/v2.1/servers/8f8ecb76-9606-4119-a5e6-53fe33413b0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:46:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-177f6523-c9ed-4bd1-963a-6e5166d608af tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Action: 'create', calling method: .version_select at 0x7f76b0ff3010>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-25581782"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:46:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-177f6523-c9ed-4bd1-963a-6e5166d608af tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.762689 Nov 21 14:46:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 334/1005] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 21 14:46:57 2023] POST /compute/v2.1/os-volumes => generated 343 bytes in 765 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 21 14:46:58 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ab087172-1bf5-426f-860d-640c1269dde8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0eb6170>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:58 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ab087172-1bf5-426f-860d-640c1269dde8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 343 microversion: 2.1 time: 0.060872 Nov 21 14:46:58 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 337/1006] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:46:58 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 343 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:46:58 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:46:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-52e1fb60-9d39-4745-b40d-a86b9672d479 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.141591 Nov 21 14:46:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 336/1007] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 21 14:46:58 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-interface => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:46:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4f41ec4e-a7ec-46b9-9dd2-ba819e92993d tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff1a20>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:46:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4f41ec4e-a7ec-46b9-9dd2-ba819e92993d tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 343 microversion: 2.1 time: 0.050051 Nov 21 14:46:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 335/1008] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:46:59 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 343 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Creating event network-changed:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:47:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Nov 21 14:47:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 338/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-931f26d5-ffa1-4358-b03b-ad3f47f09692 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/ips" status: 200 len: 109 microversion: 2.20 time: 0.035841 Nov 21 14:47:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 337/1010] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 21 14:47:00 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/ips => generated 109 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:47:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cbcaf5fb-4bea-456d-abb5-7149af92a31e tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b14d64d0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cbcaf5fb-4bea-456d-abb5-7149af92a31e tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 344 microversion: 2.1 time: 0.048721 Nov 21 14:47:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 336/1011] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:00 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-cc494c91-04c7-453a-b2cd-e90a17eb72dd tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Action: 'create', calling method: .version_select at 0x7f76b0fdd1b0>, body: {"snapshot": {"volume_id": "b3d33b5f-a996-4151-b852-c96ac531da18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-424177637"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-cc494c91-04c7-453a-b2cd-e90a17eb72dd tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.199788 Nov 21 14:47:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 339/1012] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 21 14:47:00 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-a1960f5b-7db7-4126-a94d-764674e4ad4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b1645360>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-a1960f5b-7db7-4126-a94d-764674e4ad4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.041962 Nov 21 14:47:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:01 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5fd928ac-ce9f-4b76-b05d-cc5b660396b9 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff3760>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5fd928ac-ce9f-4b76-b05d-cc5b660396b9 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.055161 Nov 21 14:47:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 337/1014] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 21 14:47:01 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d6cd2f08-d0f3-4165-a28a-4d0b7b88027b tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0eb7760>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d6cd2f08-d0f3-4165-a28a-4d0b7b88027b tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.042545 Nov 21 14:47:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 340/1015] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:01 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dae7ae01-1fa8-45b1-ade5-d96c93fc39ba tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b1647250>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dae7ae01-1fa8-45b1-ade5-d96c93fc39ba tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.046109 Nov 21 14:47:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 339/1016] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:02 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:03 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'flavor' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:47:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-17c0f0aa-a632-48ab-bfcd-6747b8cbf3ed tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0eb5e10>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-17c0f0aa-a632-48ab-bfcd-6747b8cbf3ed tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.034432 Nov 21 14:47:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 341/1017] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:03 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/action" status: 202 len: 0 microversion: 2.20 time: 0.875943 Nov 21 14:47:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 338/1018] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:47:03 2023] POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Creating event network-vif-unplugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:47:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041093 Nov 21 14:47:04 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 342/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ca2a7dbc-97a9-4bfc-b0a3-e4980b1204d8 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1707 microversion: 2.20 time: 0.305184 Nov 21 14:47:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 340/1020] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:47:03 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1707 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:47:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-40f95999-d751-4485-8b5b-ef5e85303c83 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff13f0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-40f95999-d751-4485-8b5b-ef5e85303c83 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 287 microversion: 2.1 time: 0.045132 Nov 21 14:47:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:04 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-b4ee5b63-14bb-491f-98cd-0a57524b1ee3 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0fde710>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-b4ee5b63-14bb-491f-98cd-0a57524b1ee3 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 202 len: 0 microversion: 2.1 time: 0.072145 Nov 21 14:47:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 343/1022] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 21 14:47:04 2023] DELETE /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:47:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-80c0c227-770a-4985-93fc-39103261e2fa tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b152fe20>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-80c0c227-770a-4985-93fc-39103261e2fa tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.033699 Nov 21 14:47:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 341/1023] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:04 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7723b59a-b197-48ce-8f38-f6ce34be2c93 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff0c10>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:05 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7723b59a-b197-48ce-8f38-f6ce34be2c93 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.041791 Nov 21 14:47:05 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:05 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:47:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032249 Nov 21 14:47:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 344/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4dbdeeea-90ac-4443-939f-4b9e04e332ba tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b131cc10>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4dbdeeea-90ac-4443-939f-4b9e04e332ba tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 200 len: 286 microversion: 2.1 time: 0.050308 Nov 21 14:47:06 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 342/1026] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:06 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-42f6b604-e62d-45eb-bfd7-2929580c333a tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff1f30>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-42f6b604-e62d-45eb-bfd7-2929580c333a tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] HTTP exception thrown: Snapshot 4edb4624-9b09-40b4-9023-8990f9aa83d3 could not be found. Nov 21 14:47:07 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-42f6b604-e62d-45eb-bfd7-2929580c333a tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Returning 404 to user: Snapshot 4edb4624-9b09-40b4-9023-8990f9aa83d3 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:07 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-42f6b604-e62d-45eb-bfd7-2929580c333a tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3" status: 404 len: 111 microversion: 2.1 time: 0.034215 Nov 21 14:47:07 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 21 14:47:07 2023] GET /compute/v2.1/os-snapshots/4edb4624-9b09-40b4-9023-8990f9aa83d3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:07 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ccf79f78-f904-4190-ab84-12351af22ad1 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0eb4c10>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:07 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ccf79f78-f904-4190-ab84-12351af22ad1 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 202 len: 0 microversion: 2.1 time: 0.070850 Nov 21 14:47:07 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 345/1028] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:47:07 2023] DELETE /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:47:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-73cd7570-ba1e-44be-ad3a-09931ce998cd tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b1645480>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-73cd7570-ba1e-44be-ad3a-09931ce998cd tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 343 microversion: 2.1 time: 0.055536 Nov 21 14:47:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 343/1029] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:07 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 343 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3e4c4bea-21e9-43da-b0b3-d840701095ed tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff0940>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3e4c4bea-21e9-43da-b0b3-d840701095ed tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 343 microversion: 2.1 time: 0.051340 Nov 21 14:47:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:08 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Creating event network-changed:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:47:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036312 Nov 21 14:47:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 346/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b634f687-97a3-4545-912f-22ff86731c42 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b16449d0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b634f687-97a3-4545-912f-22ff86731c42 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 200 len: 343 microversion: 2.1 time: 0.063945 Nov 21 14:47:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 344/1032] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:09 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 343 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:47:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6fc7e3ca-9e5f-4379-b407-909e119bb0b7 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0ff2e60>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-6fc7e3ca-9e5f-4379-b407-909e119bb0b7 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] HTTP exception thrown: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. Nov 21 14:47:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6fc7e3ca-9e5f-4379-b407-909e119bb0b7 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Returning 404 to user: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6fc7e3ca-9e5f-4379-b407-909e119bb0b7 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 404 len: 109 microversion: 2.1 time: 0.035883 Nov 21 14:47:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:11 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0b9ab4c9-a211-456f-84c9-94a7e125ed4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b0eb5c60>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0b9ab4c9-a211-456f-84c9-94a7e125ed4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] HTTP exception thrown: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. Nov 21 14:47:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0b9ab4c9-a211-456f-84c9-94a7e125ed4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Returning 404 to user: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0b9ab4c9-a211-456f-84c9-94a7e125ed4c tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 404 len: 109 microversion: 2.1 time: 0.032663 Nov 21 14:47:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 347/1034] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:47:11 2023] DELETE /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f078b7c6-ebd0-49a8-b854-c0d4587fb3a8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Calling method '.version_select at 0x7f76b1647520>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:11 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-f078b7c6-ebd0-49a8-b854-c0d4587fb3a8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] HTTP exception thrown: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. Nov 21 14:47:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f078b7c6-ebd0-49a8-b854-c0d4587fb3a8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] Returning 404 to user: Volume b3d33b5f-a996-4151-b852-c96ac531da18 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:11 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f078b7c6-ebd0-49a8-b854-c0d4587fb3a8 tempest-VolumesSnapshotsTestJSON-1370564678 tempest-VolumesSnapshotsTestJSON-1370564678-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18" status: 404 len: 109 microversion: 2.1 time: 0.041480 Nov 21 14:47:11 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 345/1035] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:11 2023] GET /compute/v2.1/os-volumes/b3d33b5f-a996-4151-b852-c96ac531da18 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-93d79923-f264-4b7b-bbcc-6a7945fb4529 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Action: 'create', calling method: .version_select at 0x7f76b0ff1ea0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1019696723", "metadata": {"Type": "work"}}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-93d79923-f264-4b7b-bbcc-6a7945fb4529 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-93d79923-f264-4b7b-bbcc-6a7945fb4529 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.164570 Nov 21 14:47:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 344/1036] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 21 14:47:12 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d50ecd73-c55d-45b7-9f33-d8e44a67306c tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Action: 'create', calling method: .version_select at 0x7f76b0ef4670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-625198455", "metadata": {"Type": "work"}}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d50ecd73-c55d-45b7-9f33-d8e44a67306c tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d50ecd73-c55d-45b7-9f33-d8e44a67306c tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009385 Nov 21 14:47:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 348/1037] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 21 14:47:12 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0da8ee38-a31c-4b36-98fe-f92a3d58156a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Action: 'create', calling method: .version_select at 0x7f76b1645120>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-480244417", "metadata": {"Type": "work"}}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:47:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0da8ee38-a31c-4b36-98fe-f92a3d58156a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0da8ee38-a31c-4b36-98fe-f92a3d58156a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010364 Nov 21 14:47:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 346/1038] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 21 14:47:12 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9bedb4c5-dea3-4679-97fc-cb38fad69829 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Calling method '.version_select at 0x7f76b0fab520>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-9bedb4c5-dea3-4679-97fc-cb38fad69829 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] HTTP exception thrown: Volume tempest-invalid-295571165 could not be found. Nov 21 14:47:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9bedb4c5-dea3-4679-97fc-cb38fad69829 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 404 to user: Volume tempest-invalid-295571165 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9bedb4c5-dea3-4679-97fc-cb38fad69829 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-295571165" status: 404 len: 98 microversion: 2.1 time: 0.032055 Nov 21 14:47:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 345/1039] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 21 14:47:12 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-295571165 => generated 98 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-24bc81a7-8043-466d-bebe-0346794300d1 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003474 Nov 21 14:47:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 349/1040] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 21 14:47:12 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bbe783aa-8059-4213-82f7-90bc64b3324e tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003853 Nov 21 14:47:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 347/1041] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 21 14:47:12 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 21 14:47:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5fe43f1d-0b69-4c13-badd-a74ac396800a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Calling method '.version_select at 0x7f76b0ff2b00>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-5fe43f1d-0b69-4c13-badd-a74ac396800a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] HTTP exception thrown: Volume b114e9d6-0015-42ea-a203-b97efacc57f7 could not be found. Nov 21 14:47:13 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5fe43f1d-0b69-4c13-badd-a74ac396800a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 404 to user: Volume b114e9d6-0015-42ea-a203-b97efacc57f7 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:13 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5fe43f1d-0b69-4c13-badd-a74ac396800a tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b114e9d6-0015-42ea-a203-b97efacc57f7" status: 404 len: 109 microversion: 2.1 time: 0.031987 Nov 21 14:47:13 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:47:12 2023] DELETE /compute/v2.1/os-volumes/b114e9d6-0015-42ea-a203-b97efacc57f7 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-29d8b1aa-60be-48f3-b9e5-31ef20323a59 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Calling method '.version_select at 0x7f76b0eb6290>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-29d8b1aa-60be-48f3-b9e5-31ef20323a59 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] HTTP exception thrown: Volume 73c0df10-5a3c-4637-ae4d-17123194b412 could not be found. Nov 21 14:47:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-29d8b1aa-60be-48f3-b9e5-31ef20323a59 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] Returning 404 to user: Volume 73c0df10-5a3c-4637-ae4d-17123194b412 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:47:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-29d8b1aa-60be-48f3-b9e5-31ef20323a59 tempest-VolumesNegativeTest-781525450 tempest-VolumesNegativeTest-781525450-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/73c0df10-5a3c-4637-ae4d-17123194b412" status: 404 len: 109 microversion: 2.1 time: 0.032399 Nov 21 14:47:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 350/1043] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:47:13 2023] GET /compute/v2.1/os-volumes/73c0df10-5a3c-4637-ae4d-17123194b412 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-b4778eed-866b-489c-b875-f300332cffc3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1703 microversion: 2.1 time: 0.220811 Nov 21 14:47:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 348/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:47:35 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1703 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:54 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:47:54 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c895359b-8cc6-4d01-87dd-9f8d6044574e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1648 microversion: 2.20 time: 0.443577 Nov 21 14:47:54 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 347/1045] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:47:54 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1648 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:36 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:36 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action" status: 202 len: 0 microversion: 2.1 time: 0.414815 Nov 21 14:48:36 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 351/1046] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:48:36 2023] POST /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:36 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:36 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-486df657-ec98-4447-97d3-7698b2df1157 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.335987 Nov 21 14:48:36 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 349/1047] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 14:48:36 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-interface => generated 283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-unplugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Creating event network-vif-unplugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034390 Nov 21 14:48:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 348/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:37 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Creating event network-changed:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086379 Nov 21 14:48:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 352/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:39 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}, {"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029470 Nov 21 14:48:39 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 350/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:39 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Creating event network-changed:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035617 Nov 21 14:48:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 349/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:48:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Nov 21 14:48:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 353/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:48:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:54 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:54 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cbb4aa-2aa2-4b98-b0c5-716f113c901d"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:54 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-65a1e271-1c48-4f7a-8b6c-88a11ee9e005 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.428727 Nov 21 14:48:55 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 351/1053] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 21 14:48:54 2023] POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments => generated 188 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-94777087-6811-46c0-9bd1-579128a4f1b7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments/61cbb4aa-2aa2-4b98-b0c5-716f113c901d" status: 202 len: 0 microversion: 2.20 time: 0.345281 Nov 21 14:48:55 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 350/1054] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 21 14:48:55 2023] DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments/61cbb4aa-2aa2-4b98-b0c5-716f113c901d => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64452) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 21 14:48:55 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/action" status: 202 len: 0 microversion: 2.20 time: 0.100373 Nov 21 14:48:55 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 354/1055] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 21 14:48:55 2023] POST /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:55 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:56 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:48:56 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:48:56 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:48:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7ceaaec2-63ed-4883-87f5-6ae01defddcf tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1656 microversion: 2.20 time: 0.283078 Nov 21 14:48:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 352/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:48:55 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1656 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:48:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:48:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:48:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:48:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:48:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Creating event network-changed:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:48:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031505 Nov 21 14:48:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 351/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:49:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:49:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:49:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046281 Nov 21 14:49:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 355/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:49:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:49:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Nov 21 14:49:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 353/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:49:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:09 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'services' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:49:09 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments/1d5fbba4-7b74-466e-a418-04fc7576669e" status: 202 len: 0 microversion: 2.1 time: 0.173198 Nov 21 14:49:09 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 352/1060] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:49:09 2023] DELETE /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments/1d5fbba4-7b74-466e-a418-04fc7576669e => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-fd01e706-80a0-496c-bbec-5e3f8a4f0892 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049883 Nov 21 14:49:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 356/1061] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:49:09 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:49:46 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:49:46 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-df02c5e0-f6e5-4ae7-a14f-830b576d03d2 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1701 microversion: 2.20 time: 0.200839 Nov 21 14:49:46 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 354/1062] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:49:46 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1701 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:49:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:49:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3bd63189-ee2b-4321-b671-a71e3838e2f3 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053288 Nov 21 14:49:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 353/1063] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:49:59 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:49:59 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4bbee94e-76bb-48f7-bf71-5ba7ac77b10e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '.version_select at 0x7f76b0fde290>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:49:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:49:59 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-4bbee94e-76bb-48f7-bf71-5ba7ac77b10e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e" status: 204 len: 0 microversion: 2.1 time: 0.585764 Nov 21 14:50:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 357/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:49:59 2023] DELETE /compute/v2.1/images/fe09c065-b11f-42ae-8da0-38f1328ac27e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:00 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:50:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 204 len: 0 microversion: 2.1 time: 0.110644 Nov 21 14:50:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 355/1065] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:50:00 2023] DELETE /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:50:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-317e05f9-9e10-4299-aa00-259c2ea5d309 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 200 len: 1677 microversion: 2.1 time: 0.277213 Nov 21 14:50:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 354/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:50:00 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:50:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-unplugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Creating event network-vif-unplugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:50:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031502 Nov 21 14:50:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 358/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:50:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-plugged", "status": "completed", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}, {"server_uuid": "2be9dfed-8102-4797-9d47-13041ed0a4ef", "name": "network-vif-deleted", "tag": "9c201a78-a3ad-4da1-9620-26544a9493b9"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Creating event network-vif-plugged:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:50:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Creating event network-vif-deleted:9c201a78-a3ad-4da1-9620-26544a9493b9 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef on user Nov 21 14:50:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033345 Nov 21 14:50:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 356/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c21499cf-b407-41e3-972b-fa89131d1349 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052653 Nov 21 14:50:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 355/1069] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 21 14:50:46 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:50:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 204 len: 0 microversion: 2.20 time: 0.113221 Nov 21 14:50:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 359/1070] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:50:46 2023] DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:46 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:50:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:50:47 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:50:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-5d0db52a-3856-4c48-b75d-b0821cd62df7 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 200 len: 1707 microversion: 2.20 time: 0.251734 Nov 21 14:50:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 357/1071] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:50:46 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 1707 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 14:50:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Creating event network-vif-unplugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101396 Nov 21 14:50:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 356/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:50:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:50:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-deleted", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] Creating event network-vif-deleted:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126817 Nov 21 14:50:48 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 360/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:50:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:50:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}, {"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}, {"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}, {"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}, {"server_uuid": "3cf2345b-bb3d-4bab-a89a-ca50af5fd539", "name": "network-vif-plugged", "status": "completed", "tag": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Creating event network-vif-unplugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Creating event network-vif-plugged:bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 on user Nov 21 14:50:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033962 Nov 21 14:50:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 358/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:50:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] HTTP exception thrown: Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef could not be found. Nov 21 14:50:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Returning 404 to user: Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:50:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-20fd20b6-8f16-4afa-9a5f-4b6cb90a867e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef" status: 404 len: 111 microversion: 2.1 time: 0.035386 Nov 21 14:50:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 357/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:50:50 2023] GET /compute/v2.1/servers/2be9dfed-8102-4797-9d47-13041ed0a4ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:50:50 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-551aae26-4db3-4bf1-a22a-887a801b9a37 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Calling method '.version_select at 0x7f76b0fddfc0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:50 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-551aae26-4db3-4bf1-a22a-887a801b9a37 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394726022" status: 202 len: 0 microversion: 2.1 time: 0.021757 Nov 21 14:50:50 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 361/1076] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 14:50:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394726022 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:50:59 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1a3e656b-2c6c-46d4-931c-ebcf3ec237a2 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Action: 'create', calling method: .version_select at 0x7f76b18f9900>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-681450839", "metadata": {"Type": "work"}}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:50:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:59 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:50:59 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1a3e656b-2c6c-46d4-931c-ebcf3ec237a2 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.459810 Nov 21 14:50:59 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 359/1077] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 21 14:50:59 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 462 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 21 14:50:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-88757091-7930-46be-b764-a59df26f138f tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b17cfd90>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:50:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-88757091-7930-46be-b764-a59df26f138f tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 352 microversion: 2.1 time: 0.055606 Nov 21 14:50:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 358/1078] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:50:59 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ccc7f67b-1aa3-44d7-b6e3-9e0febef8842 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b0eb5fc0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ccc7f67b-1aa3-44d7-b6e3-9e0febef8842 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 352 microversion: 2.1 time: 0.057703 Nov 21 14:51:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 362/1079] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:00 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-89a58bb3-04c3-4a05-a163-df7647e1c6ce tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b1393d00>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-89a58bb3-04c3-4a05-a163-df7647e1c6ce tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 353 microversion: 2.1 time: 0.049105 Nov 21 14:51:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 360/1080] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:01 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8dfaea45-0f42-4ae9-b3f2-d0e55d7bdd6a tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b0ff08b0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=10 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8dfaea45-0f42-4ae9-b3f2-d0e55d7bdd6a tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 353 microversion: 2.1 time: 0.051360 Nov 21 14:51:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 359/1081] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:01 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:01 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-9265916a-0359-4f82-b88e-b28632492fec tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b0fde0e0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-9265916a-0359-4f82-b88e-b28632492fec tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 202 len: 0 microversion: 2.1 time: 0.075125 Nov 21 14:51:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 363/1082] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 21 14:51:01 2023] DELETE /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:51:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6f4f6de7-7d88-40e6-94da-6f2e3232086f tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b152f400>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6f4f6de7-7d88-40e6-94da-6f2e3232086f tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 352 microversion: 2.1 time: 0.051382 Nov 21 14:51:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 361/1083] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:01 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-73a885fe-14bc-4fc3-840b-58f9809aa900 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b12e6c20>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:03 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-73a885fe-14bc-4fc3-840b-58f9809aa900 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 352 microversion: 2.1 time: 0.074698 Nov 21 14:51:03 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 360/1084] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:02 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-cfd8858c-52e8-48e8-8c3f-75bd7b2c0f31 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b0fdcdc0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-cfd8858c-52e8-48e8-8c3f-75bd7b2c0f31 tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 200 len: 352 microversion: 2.1 time: 0.092620 Nov 21 14:51:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 364/1085] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:04 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-29604b9a-afa7-428f-a339-3e6db7f1646c tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Calling method '.version_select at 0x7f76b1647250>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-29604b9a-afa7-428f-a339-3e6db7f1646c tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] HTTP exception thrown: Volume 8ee27317-b250-48e1-b82b-a06f6ec53fbd could not be found. Nov 21 14:51:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-29604b9a-afa7-428f-a339-3e6db7f1646c tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] Returning 404 to user: Volume 8ee27317-b250-48e1-b82b-a06f6ec53fbd could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:05 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-29604b9a-afa7-428f-a339-3e6db7f1646c tempest-VolumesGetTestJSON-991945485 tempest-VolumesGetTestJSON-991945485-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd" status: 404 len: 109 microversion: 2.1 time: 0.038878 Nov 21 14:51:05 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 362/1086] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 21 14:51:05 2023] GET /compute/v2.1/os-volumes/8ee27317-b250-48e1-b82b-a06f6ec53fbd => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:51:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-a383d013-e958-4d5d-a010-66c5830249c7 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: .version_select at 0x7f76b0f63b50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1354020085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:51:20 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a383d013-e958-4d5d-a010-66c5830249c7 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:51:20 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-a383d013-e958-4d5d-a010-66c5830249c7 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for user e89a65d91d2f4dd9b1b143107b84d2b2 and project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:51:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-a383d013-e958-4d5d-a010-66c5830249c7 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051446 Nov 21 14:51:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 361/1087] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:51:20 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1374358955", "imageRef": "51f4fba5-d6ff-4868-8646-c13206d23e0f", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1354020085", "networks": [{"uuid": "6a1d901c-33bb-4608-93f8-525db0fd1706"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] validate_networks() for [('6a1d901c-33bb-4608-93f8-525db0fd1706', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for user e89a65d91d2f4dd9b1b143107b84d2b2 and project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:51:20 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='51f4fba5-d6ff-4868-8646-c13206d23e0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:51:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.617027 Nov 21 14:51:21 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 365/1088] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:51:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:51:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3673be2c-7058-4e6c-b125-f03b5faec15c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:21 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3673be2c-7058-4e6c-b125-f03b5faec15c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:21 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3673be2c-7058-4e6c-b125-f03b5faec15c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:51:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3673be2c-7058-4e6c-b125-f03b5faec15c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1251 microversion: 2.1 time: 0.136435 Nov 21 14:51:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 363/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:51:21 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1251 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:51:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:51:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Creating event network-changed:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:51:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035566 Nov 21 14:51:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 362/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:51:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:51:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033951 Nov 21 14:51:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 366/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:51:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:51:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Nov 21 14:51:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 364/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. Nov 21 14:51:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3545a855-12ee-4ffa-a998-7a94426e1c65 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 404 len: 111 microversion: 2.20 time: 0.036699 Nov 21 14:51:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 363/1093] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:51:37 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:51:37 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:37 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-95e7e1dc-13e3-47ee-af7e-e76077b00d84 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '.version_select at 0x7f76b0ef43a0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:37 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-95e7e1dc-13e3-47ee-af7e-e76077b00d84 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578555145" status: 204 len: 0 microversion: 2.20 time: 0.030280 Nov 21 14:51:37 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 367/1094] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 21 14:51:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578555145 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. Nov 21 14:51:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1a524225-c47a-40b8-99cf-c973ce7702db tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 404 len: 111 microversion: 2.20 time: 0.038347 Nov 21 14:51:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 365/1095] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:51:41 2023] DELETE /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. Nov 21 14:51:41 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:41 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-fc06f63f-8104-4021-a13f-0c5b17619653 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539" status: 404 len: 111 microversion: 2.20 time: 0.029758 Nov 21 14:51:41 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 364/1096] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:51:41 2023] GET /compute/v2.1/servers/3cf2345b-bb3d-4bab-a89a-ca50af5fd539 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. Nov 21 14:51:44 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:44 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0bdbf2f4-36ea-422b-9bf4-d64bd5d57336 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 404 len: 111 microversion: 2.20 time: 0.028832 Nov 21 14:51:44 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 368/1097] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 21 14:51:44 2023] DELETE /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:51:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HTTP exception thrown: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. Nov 21 14:51:44 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Returning 404 to user: Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:51:44 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-4e698daa-5a11-4a53-a734-a45e57de99d5 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" status: 404 len: 111 microversion: 2.20 time: 0.032772 Nov 21 14:51:44 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 366/1098] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 21 14:51:44 2023] GET /compute/v2.1/servers/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:52:11 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:52:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3b9934ce-4337-4c56-9c0b-17d0ecd9ba3f tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1536 microversion: 2.1 time: 0.275570 Nov 21 14:52:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 365/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:52:11 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1536 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:11 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:11 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-992c181d-27ff-4004-8ae7-16636bb29b43 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1536 microversion: 2.1 time: 0.214319 Nov 21 14:53:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 369/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:53:11 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1536 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:11 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:53:11 user devstack@n-api.service[64453]: Tue Nov 21 14:53:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 14:53:11 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:53:11 user devstack@n-api.service[64453]: Tue Nov 21 14:53:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching by: {'deleted': False, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc'} {{(pid=64453) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:11 user devstack@n-api.service[64453]: DEBUG nova.compute.multi_cell_list [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 21 14:53:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-61d472a8-ca21-47a7-9d80-fde49c579cf4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.223439 Nov 21 14:53:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 21 14:53:11 2023] GET /compute/v2.1/servers => generated 341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:12 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:12 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1c7bf380-92b4-4fa7-9755-8d7ef903ca6a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1536 microversion: 2.1 time: 0.381385 Nov 21 14:53:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 366/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:53:12 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1536 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4724c4e0-75c0-489b-b122-5af4eb077ba8"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:15 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41504. Nov 21 14:53:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310043 Nov 21 14:53:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 370/1103] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:53:15 2023] POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:27 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-1e824530-8f64-42e2-9b50-099bd3414e70 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1582 microversion: 2.1 time: 0.265853 Nov 21 14:53:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:53:27 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1582 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:29 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Creating event network-changed:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:29 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045704 Nov 21 14:53:29 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 367/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1812901586"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:30 user devstack@n-api.service[64452]: INFO nova.network.security_group_api [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Adding security group dd967737-62b2-4012-8b41-797357d96a40 to port c66b624c-4a21-42f8-99af-379770f4f587 Nov 21 14:53:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-4fc03d05-46cd-426c-a71e-ac7fe0770ee0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action" status: 202 len: 0 microversion: 2.1 time: 0.577838 Nov 21 14:53:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 371/1106] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:53:30 2023] POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:53:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:31 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51846. Nov 21 14:53:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Creating event network-changed:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027299 Nov 21 14:53:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 369/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:31 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-150fc834-4065-4743-b52c-0cda00410a25 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1748 microversion: 2.1 time: 0.234981 Nov 21 14:53:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 368/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:53:31 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1748 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action" status: 202 len: 0 microversion: 2.1 time: 0.090520 Nov 21 14:53:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 372/1109] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:53:35 2023] POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:35 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:53:35 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-324003ba-b5e1-48e8-9b47-beca65edfe93 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1750 microversion: 2.1 time: 0.429488 Nov 21 14:53:35 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:53:35 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1750 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:53:36 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-unplugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:36 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Creating event network-vif-unplugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:36 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029832 Nov 21 14:53:36 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 369/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130170 Nov 21 14:53:38 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 373/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:41 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:41 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:41 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Nov 21 14:53:41 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 371/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:53:43 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:53:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:53:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:53:43 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:53:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:53:43 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050511 Nov 21 14:53:43 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 370/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:54:25 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:54:26 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:54:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-685b1ccf-6d83-4e4b-8796-6e5e7e126a31 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1748 microversion: 2.1 time: 0.260664 Nov 21 14:54:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 374/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:54:25 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1748 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=16 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1812901586"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:26 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:27 user devstack@n-api.service[64453]: INFO nova.network.security_group_api [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Removing security group dd967737-62b2-4012-8b41-797357d96a40 from port c66b624c-4a21-42f8-99af-379770f4f587 Nov 21 14:55:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-90379169-4965-4483-9853-5fd2283b4029 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action" status: 202 len: 0 microversion: 2.1 time: 0.728027 Nov 21 14:55:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 372/1116] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:55:26 2023] POST /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:27 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:55:27 user devstack@n-api.service[64454]: Tue Nov 21 14:55:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:27 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:27 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Creating event network-changed:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:55:27 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048105 Nov 21 14:55:27 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 371/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Creating event network-changed:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:55:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036330 Nov 21 14:55:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 375/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:55:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:28 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'services' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 14:55:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments/4724c4e0-75c0-489b-b122-5af4eb077ba8" status: 202 len: 0 microversion: 2.1 time: 0.171180 Nov 21 14:55:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 373/1119] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:55:28 2023] DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments/4724c4e0-75c0-489b-b122-5af4eb077ba8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:55:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:55:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-52693a4f-2293-40af-9e9e-3b219a370e32 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Nov 21 14:55:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 372/1120] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:55:28 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c4cb24a3-1fae-4afa-b05b-df54e40e5565 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153147 Nov 21 14:56:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 376/1121] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 14:56:18 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HTTP exception thrown: Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 is not attached to volume 4724c4e0-75c0-489b-b122-5af4eb077ba8 Nov 21 14:56:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Returning 404 to user: Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 is not attached to volume 4724c4e0-75c0-489b-b122-5af4eb077ba8 {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:56:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-62e5511b-d4bf-43b4-a621-88bdc1fc78a6 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments/4724c4e0-75c0-489b-b122-5af4eb077ba8" status: 404 len: 154 microversion: 2.1 time: 0.096103 Nov 21 14:56:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 374/1122] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 14:56:18 2023] DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/os-volume_attachments/4724c4e0-75c0-489b-b122-5af4eb077ba8 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 14:56:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 204 len: 0 microversion: 2.1 time: 0.119723 Nov 21 14:56:22 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 373/1123] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 14:56:22 2023] DELETE /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-unplugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:56:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Creating event network-vif-unplugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:56:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029717 Nov 21 14:56:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 375/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:56:22 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:56:22 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-10e5c0a8-12bd-4f60-a269-596253b41996 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 200 len: 1542 microversion: 2.1 time: 0.346303 Nov 21 14:56:22 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 377/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:56:22 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 1542 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:56:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-deleted", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:56:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] Creating event network-vif-deleted:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:56:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100526 Nov 21 14:56:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 374/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:56:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203f1ad6-0f2b-4b04-a94f-a1f690a901c8", "name": "network-vif-plugged", "status": "completed", "tag": "c66b624c-4a21-42f8-99af-379770f4f587"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:56:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:56:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:56:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:56:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Creating event network-vif-plugged:c66b624c-4a21-42f8-99af-379770f4f587 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 on user Nov 21 14:56:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029533 Nov 21 14:56:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 376/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:56:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:57:12 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:57:12 user devstack@n-api.service[64452]: Tue Nov 21 14:57:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 (ip 10.0.0.210) !!! Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HTTP exception thrown: Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 could not be found. Nov 21 14:57:12 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Returning 404 to user: Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:57:12 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a277e5ed-857e-4acd-ba06-9c94c9d3f405 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8" status: 404 len: 111 microversion: 2.1 time: 0.045852 Nov 21 14:57:12 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 378/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:57:12 2023] GET /compute/v2.1/servers/203f1ad6-0f2b-4b04-a94f-a1f690a901c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:57:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8dd9733c-ae71-4260-b35e-56303e85b9d5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '.version_select at 0x7f76b0f61b40>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:57:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8dd9733c-ae71-4260-b35e-56303e85b9d5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1354020085" status: 202 len: 0 microversion: 2.1 time: 0.035316 Nov 21 14:57:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 375/1129] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Nov 21 14:57:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1354020085 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:57:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=10 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:57:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-cb0ddad6-eede-4627-bcb7-e83ed756fedf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: .version_select at 0x7f76b1274040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-970885429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeu5WaR9uaggnOaimLuzirOc8k7snoiRJ9ghk2/5FdDgSPtSEGnDDDIyc+tSFx6R3L3c4lkXOjG4ppgFcJ5TJ1N9RpnsciKPe0FWmpjaWHF1Xon+kpG+TCFMHQOa5oQQ=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:57:15 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-cb0ddad6-eede-4627-bcb7-e83ed756fedf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:57:15 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-cb0ddad6-eede-4627-bcb7-e83ed756fedf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for user e89a65d91d2f4dd9b1b143107b84d2b2 and project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:57:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-cb0ddad6-eede-4627-bcb7-e83ed756fedf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061549 Nov 21 14:57:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 377/1130] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 14:57:15 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:57:15 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1743715161", "imageRef": "abe2b915-0cc6-49c0-93e0-40433a6f5990", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-970885429", "networks": [{"uuid": "6a1d901c-33bb-4608-93f8-525db0fd1706"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] validate_networks() for [('6a1d901c-33bb-4608-93f8-525db0fd1706', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting quotas for user e89a65d91d2f4dd9b1b143107b84d2b2 and project ddd03d02c8844c0fa58fa10c7c1dcbbc. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 14:57:15 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abe2b915-0cc6-49c0-93e0-40433a6f5990',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 14:57:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.514989 Nov 21 14:57:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 379/1131] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 14:57:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 14:57:15 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f1d2348e-b62d-4a02-9a0c-b943d1e4ace9 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:57:15 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f1d2348e-b62d-4a02-9a0c-b943d1e4ace9 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:57:15 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f1d2348e-b62d-4a02-9a0c-b943d1e4ace9 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:57:15 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f1d2348e-b62d-4a02-9a0c-b943d1e4ace9 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1250 microversion: 2.1 time: 0.095901 Nov 21 14:57:15 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 376/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:57:15 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:57:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:57:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Creating event network-changed:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:57:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037811 Nov 21 14:57:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 378/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:57:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:57:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:20 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44364. Nov 21 14:57:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:57:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035711 Nov 21 14:57:20 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 380/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:57:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:57:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:57:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:57:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:57:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:57:22 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029959 Nov 21 14:57:22 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 377/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:58:05 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:58:05 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:58:06 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:58:06 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dfb291ff-c6eb-41cb-834e-93cf3aa856ea tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1534 microversion: 2.1 time: 0.222801 Nov 21 14:58:06 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 379/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:58:05 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1534 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c1b5adef-60f4-4b91-9435-8bd5aee7cf1c tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1534 microversion: 2.1 time: 0.557865 Nov 21 14:59:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 381/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:59:06 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1534 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:06 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:59:06 user devstack@n-api.service[64454]: Tue Nov 21 14:59:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching by: {'deleted': False, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc'} {{(pid=64454) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64454]: DEBUG nova.compute.multi_cell_list [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=64454) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 21 14:59:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-7e7f731b-e891-4d3c-880d-a2e12a479e0a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.087967 Nov 21 14:59:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 378/1138] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 21 14:59:06 2023] GET /compute/v2.1/servers => generated 341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:06 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50930. Nov 21 14:59:07 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3ef0cdc9-7fc0-4995-b2d2-5ae2c77ac9bd tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1534 microversion: 2.1 time: 0.221452 Nov 21 14:59:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 380/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:59:06 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1534 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b864b3c-f072-405f-bf25-f24509e7ad47"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:09 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319379 Nov 21 14:59:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 382/1140] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 14:59:09 2023] POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:18 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45758. Nov 21 14:59:19 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-da09b448-4577-4009-81c8-0ab616162dff tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1580 microversion: 2.1 time: 0.314270 Nov 21 14:59:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 379/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:59:18 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1580 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Creating event network-changed:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136724 Nov 21 14:59:20 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 381/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:59:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1352397689"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:22 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:22 user devstack@n-api.service[64452]: INFO nova.network.security_group_api [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Adding security group 4aa700a8-546f-4687-9e8f-4175f5e5df7f to port c83ac310-48f6-4cf2-8a27-db58247270ba Nov 21 14:59:22 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-af3faae9-8d76-4b22-a33d-5a287239d394 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action" status: 202 len: 0 microversion: 2.1 time: 0.601643 Nov 21 14:59:22 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 383/1143] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:59:22 2023] POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:22 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Creating event network-changed:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:23 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095155 Nov 21 14:59:23 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 382/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:59:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:23 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6412be63-3477-46b8-8368-25a04bc675f4 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1745 microversion: 2.1 time: 0.183496 Nov 21 14:59:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 380/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:59:22 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:23 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:23 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action" status: 202 len: 0 microversion: 2.1 time: 0.087680 Nov 21 14:59:23 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 384/1146] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 14:59:23 2023] POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:23 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:24 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 14:59:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0ea6416c-32e5-4a5b-80b4-5dde2db5bcb5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1737 microversion: 2.1 time: 0.803960 Nov 21 14:59:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 383/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 14:59:23 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1737 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:59:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-unplugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Creating event network-vif-unplugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034165 Nov 21 14:59:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 381/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:59:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}, {"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052423 Nov 21 14:59:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 385/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:59:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:59:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 14:59:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 14:59:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 14:59:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 14:59:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Nov 21 14:59:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 384/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 14:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:00:14 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:00:14 user devstack@n-api.service[64454]: Tue Nov 21 15:00:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 (ip 10.0.0.210) !!! Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=14 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:00:14 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:00:14 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-328265eb-bf4b-4e23-bd76-e364d0bc9589 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1745 microversion: 2.1 time: 0.260742 Nov 21 15:00:14 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 382/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:00:14 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1745 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:01:14 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 21 15:01:14 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:01:14 user devstack@n-api.service[64452]: Tue Nov 21 15:01:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action (ip 10.0.0.210) !!! Nov 21 15:01:14 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:01:14 user devstack@n-api.service[64452]: Tue Nov 21 15:01:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action (ip 10.0.0.210) !!! Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1352397689"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:14 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:15 user devstack@n-api.service[64452]: INFO nova.network.security_group_api [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Removing security group 4aa700a8-546f-4687-9e8f-4175f5e5df7f from port c83ac310-48f6-4cf2-8a27-db58247270ba Nov 21 15:01:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2a8f2117-9117-4c5e-b55e-c2ac67041170 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action" status: 202 len: 0 microversion: 2.1 time: 0.647691 Nov 21 15:01:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 386/1152] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 15:01:14 2023] POST /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:01:15 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:15 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:01:15 user devstack@n-api.service[64453]: Tue Nov 21 15:01:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:01:15 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:01:15 user devstack@n-api.service[64453]: Tue Nov 21 15:01:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=12 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Creating event network-changed:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 15:01:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049110 Nov 21 15:01:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 385/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:01:16 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:16 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:16 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41424. Nov 21 15:01:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Creating event network-changed:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 15:01:16 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 Nov 21 15:01:16 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 387/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:01:16 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'services' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:01:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments/1b864b3c-f072-405f-bf25-f24509e7ad47" status: 202 len: 0 microversion: 2.1 time: 0.181709 Nov 21 15:01:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 383/1155] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:01:16 2023] DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments/1b864b3c-f072-405f-bf25-f24509e7ad47 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:01:16 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:01:16 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41436. Nov 21 15:01:16 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-456df685-cf6b-4667-84c9-d7b28e6a4e1a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054186 Nov 21 15:01:16 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 386/1156] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:01:16 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:06 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:06 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-17f424d9-e103-4d34-9702-0229de11cf2a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048871 Nov 21 15:02:06 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 388/1157] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:02:06 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HTTP exception thrown: Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 is not attached to volume 1b864b3c-f072-405f-bf25-f24509e7ad47 Nov 21 15:02:06 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Returning 404 to user: Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 is not attached to volume 1b864b3c-f072-405f-bf25-f24509e7ad47 {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:02:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-26d2d50e-1e80-4ed8-885a-5ae9cc36d7c5 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments/1b864b3c-f072-405f-bf25-f24509e7ad47" status: 404 len: 154 microversion: 2.1 time: 0.109617 Nov 21 15:02:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 384/1158] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:02:06 2023] DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737/os-volume_attachments/1b864b3c-f072-405f-bf25-f24509e7ad47 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:02:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 204 len: 0 microversion: 2.1 time: 0.124618 Nov 21 15:02:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 387/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:02:10 2023] DELETE /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:10 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-unplugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:02:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Creating event network-vif-unplugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 15:02:10 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:02:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085752 Nov 21 15:02:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 385/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:02:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-da024bba-a943-48c6-b616-2324ccc9416a tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 200 len: 1540 microversion: 2.1 time: 0.351739 Nov 21 15:02:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 389/1161] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:02:10 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 1540 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:02:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-plugged", "status": "completed", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}, {"server_uuid": "803e69ce-6100-4c41-b07d-4dbd19adc737", "name": "network-vif-deleted", "tag": "c83ac310-48f6-4cf2-8a27-db58247270ba"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:02:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:02:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:02:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:02:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Creating event network-vif-plugged:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 15:02:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Creating event network-vif-deleted:c83ac310-48f6-4cf2-8a27-db58247270ba for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 on user Nov 21 15:02:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033331 Nov 21 15:02:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 388/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HTTP exception thrown: Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 could not be found. Nov 21 15:03:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Returning 404 to user: Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:03:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-37788936-c2cd-49c0-b984-10d337dfd449 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737" status: 404 len: 111 microversion: 2.1 time: 0.034201 Nov 21 15:03:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 386/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:03:00 2023] GET /compute/v2.1/servers/803e69ce-6100-4c41-b07d-4dbd19adc737 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:03:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a815c666-86ec-434c-9dba-d353606eb284 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Calling method '.version_select at 0x7f76b0fdcdc0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:03:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=12 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a815c666-86ec-434c-9dba-d353606eb284 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-970885429" status: 202 len: 0 microversion: 2.1 time: 0.033130 Nov 21 15:03:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 390/1164] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 21 15:03:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-970885429 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:03:19 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:19 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:19 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3b288d4a-12f9-47d6-9340-fd65a896893b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Action: 'create', calling method: .version_select at 0x7f76b11ef490>, body: {"keypair": {"name": "tempest-TestShelveInstance-1319781319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZE4/uNRWzpLI+X8O5r2KGDJOs04FbB4yADRHY6qDBNc0WOLuElyTn92rTAvHSTsq2fFl5CwRDvSxUdKbEDZQXhcees7jGatDE+JKkHHR5bik1Jf1RJTEGJK70cFhP1cQ=="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:03:19 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-3b288d4a-12f9-47d6-9340-fd65a896893b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting quotas for project 03633603b8ed4188a3a0ae67b1fea4f7. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:03:19 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-3b288d4a-12f9-47d6-9340-fd65a896893b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting quotas for user 2dee138cf9464dba92c019fd5af90350 and project 03633603b8ed4188a3a0ae67b1fea4f7. Resources: {'key_pairs'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:03:19 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3b288d4a-12f9-47d6-9340-fd65a896893b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.377814 Nov 21 15:03:19 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 389/1165] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 15:03:19 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:03:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1138712177", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-1319781319", "security_groups": [{"name": "tempest-secgroup-smoke-521959457"}], "networks": [{"uuid": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28"}], "block_device_mapping_v2": [{"uuid": "37ec0e7c-d846-40ba-ad23-9f6d42ceaee2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:03:24 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:24 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:24 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] validate_networks() for [('c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting quotas for project 03633603b8ed4188a3a0ae67b1fea4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting quotas for user 2dee138cf9464dba92c019fd5af90350 and project 03633603b8ed4188a3a0ae67b1fea4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:03:25 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37ec0e7c-d846-40ba-ad23-9f6d42ceaee2',volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:03:25 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.750762 Nov 21 15:03:25 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 387/1166] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:03:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:03:25 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:25 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1056d1c7-4ee9-4db1-8996-31c00ea5bf8b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:03:25 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-1056d1c7-4ee9-4db1-8996-31c00ea5bf8b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:03:25 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-1056d1c7-4ee9-4db1-8996-31c00ea5bf8b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:03:25 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-1056d1c7-4ee9-4db1-8996-31c00ea5bf8b tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1082 microversion: 2.1 time: 0.069456 Nov 21 15:03:25 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 391/1167] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:03:25 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1082 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:03:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:03:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Creating event network-changed:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:03:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028923 Nov 21 15:03:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 390/1168] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:03:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:03:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047284 Nov 21 15:03:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 388/1169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:03:39 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:03:39 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:03:39 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035023 Nov 21 15:03:39 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 392/1170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:04:15 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:04:15 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c0ce6281-a2e3-4531-b3f7-a9df283cc767 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1430 microversion: 2.1 time: 0.299579 Nov 21 15:04:15 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 391/1171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:04:15 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1430 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:05:16 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:05:16 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:05:16 user devstack@n-api.service[64454]: Tue Nov 21 15:05:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d (ip 10.0.0.210) !!! Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:16 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:05:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-2056e3d7-a269-4add-97be-673d04681fe8 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1430 microversion: 2.1 time: 0.286350 Nov 21 15:05:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 389/1172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:05:16 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1430 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:05:17 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:05:17 user devstack@n-api.service[64452]: Tue Nov 21 15:05:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:17 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Creating event network-changed:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:17 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128366 Nov 21 15:05:17 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 393/1173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:18 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'flavor' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:05:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "POST /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d/action" status: 202 len: 0 microversion: 2.1 time: 0.103164 Nov 21 15:05:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 392/1174] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 15:05:18 2023] POST /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:18 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50094. Nov 21 15:05:18 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:05:18 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-5365cf2c-4700-4f78-9e5b-5408d9990090 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1436 microversion: 2.1 time: 0.179791 Nov 21 15:05:18 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 390/1175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:05:18 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1436 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:05:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-unplugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:05:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:18 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Creating event network-vif-unplugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:18 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042640 Nov 21 15:05:18 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 394/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 15:05:20 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-unplugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"name": "network-changed", "server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:05:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:05:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:05:20 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-vif-unplugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Creating event network-changed:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:05:20 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1036 microversion: 2.1 time: 0.036432 Nov 21 15:05:20 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 393/1177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 1036 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:06:08 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 21 15:06:08 user devstack@n-api.service[64454]: Tue Nov 21 15:06:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d (ip 10.0.0.210) !!! Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=12 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:06:08 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:06:08 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f6dc11a4-a1df-4c14-a208-3ce2abe9fc05 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1496 microversion: 2.1 time: 0.212072 Nov 21 15:06:08 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 391/1178] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:06:08 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:09 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=64452) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 21 15:07:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "POST /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d/action" status: 202 len: 0 microversion: 2.1 time: 0.219422 Nov 21 15:07:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 395/1179] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 15:07:08 2023] POST /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:07:09 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:09 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:07:09 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-0be475a1-896e-4e6c-a4ea-7fc41699716a tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1504 microversion: 2.1 time: 0.317220 Nov 21 15:07:09 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 394/1180] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:07:09 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:07:16 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:16 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:17 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:07:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:17 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Creating event network-changed:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:07:17 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091346 Nov 21 15:07:17 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 392/1181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:20 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:07:20 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048172 Nov 21 15:07:20 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 396/1182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:22 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53066. Nov 21 15:07:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:07:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046115 Nov 21 15:07:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 395/1183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:07:59 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:07:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f28f6c68-d896-4e56-8328-22e64259e358 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1549 microversion: 2.1 time: 0.206163 Nov 21 15:07:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 393/1184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:07:59 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1549 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:09:00 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:09:00 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:09:00 user devstack@n-api.service[64452]: Tue Nov 21 15:09:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d (ip 10.0.0.210) !!! Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:09:00 user devstack@n-api.service[64453]: Tue Nov 21 15:09:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:09:00 user devstack@n-api.service[64453]: Tue Nov 21 15:09:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:00 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Creating event network-changed:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:00 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042463 Nov 21 15:09:00 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 396/1185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:09:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:09:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:09:00 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 204 len: 0 microversion: 2.1 time: 0.125060 Nov 21 15:09:00 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 397/1186] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:09:00 2023] DELETE /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:00 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:09:00 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-310698eb-ad45-444b-82a9-6a586675905f tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 200 len: 1555 microversion: 2.1 time: 0.248741 Nov 21 15:09:00 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 394/1187] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:09:00 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:09:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-unplugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:09:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Creating event network-vif-unplugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053230 Nov 21 15:09:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 397/1188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:09:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-plugged", "status": "completed", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}, {"server_uuid": "27853f33-8925-42e4-b26d-7dfb27775c3d", "name": "network-vif-deleted", "tag": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:09:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 48236. Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Creating event network-vif-plugged:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Creating event network-vif-deleted:49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance 27853f33-8925-42e4-b26d-7dfb27775c3d on user Nov 21 15:09:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.037787 Nov 21 15:09:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 398/1189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:09:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] HTTP exception thrown: Instance 27853f33-8925-42e4-b26d-7dfb27775c3d could not be found. Nov 21 15:09:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Returning 404 to user: Instance 27853f33-8925-42e4-b26d-7dfb27775c3d could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:09:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6a1a1d2a-5f7d-44f1-9a8d-58829c092fcb tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d" status: 404 len: 111 microversion: 2.1 time: 0.035197 Nov 21 15:09:51 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 395/1190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:09:51 2023] GET /compute/v2.1/servers/27853f33-8925-42e4-b26d-7dfb27775c3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:09:51 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-83870796-1b97-4985-be6e-6c06253f9897 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Calling method '.version_select at 0x7f76b12770a0>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:09:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:51 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:09:51 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-83870796-1b97-4985-be6e-6c06253f9897 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1319781319" status: 202 len: 0 microversion: 2.1 time: 0.034984 Nov 21 15:09:51 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 398/1191] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 21 15:09:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1319781319 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:10:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:18 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:18 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1182419022", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "cf7ab194-1a1a-4844-96fc-b902f6e7e415", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:10:19 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cf7ab194-1a1a-4844-96fc-b902f6e7e415',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:10:19 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.724386 Nov 21 15:10:19 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 399/1192] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:10:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:10:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-be947bc6-b878-4cda-b7e9-d198de4a4764 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:10:19 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-be947bc6-b878-4cda-b7e9-d198de4a4764 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:10:19 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 15:10:19 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:19 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:19 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-be947bc6-b878-4cda-b7e9-d198de4a4764 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:10:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-be947bc6-b878-4cda-b7e9-d198de4a4764 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 200 len: 1050 microversion: 2.1 time: 0.164316 Nov 21 15:10:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 396/1193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:10:19 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 1050 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:10:22 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:22 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:10:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:10:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:10:22 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:10:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Creating event network-changed:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:10:22 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Nov 21 15:10:22 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 399/1194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:10:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:34 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "name": "network-vif-plugged", "status": "completed", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:10:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:10:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:10:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:10:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Creating event network-vif-plugged:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:10:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202037 Nov 21 15:10:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 400/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "name": "network-vif-plugged", "status": "completed", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:10:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:10:37 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34524. Nov 21 15:10:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Creating event network-vif-plugged:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:10:37 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045364 Nov 21 15:10:37 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 397/1196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:11:09 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:11:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:11:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-378c67ea-a952-42db-9ecd-c7589643c9bb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 200 len: 1377 microversion: 2.1 time: 0.299255 Nov 21 15:11:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 400/1197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:11:09 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 1377 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:12:10 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:12:10 user devstack@n-api.service[64452]: Tue Nov 21 15:12:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd (ip 10.0.0.210) !!! Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:12:10 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ebac2ad8-5b30-4175-b9b5-07ca2915a48b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 200 len: 1377 microversion: 2.1 time: 0.281337 Nov 21 15:12:10 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 401/1198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:12:10 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 1377 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:12:10 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:12:10 user devstack@n-api.service[64454]: Tue Nov 21 15:12:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd (ip 10.0.0.210) !!! Nov 21 15:12:10 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:12:10 user devstack@n-api.service[64454]: Tue Nov 21 15:12:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd (ip 10.0.0.210) !!! Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:12:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f6c90c78-15d1-46d1-a626-3b74a5329f57 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 200 len: 1377 microversion: 2.1 time: 0.275654 Nov 21 15:12:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 398/1199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:12:10 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 1377 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:12:10 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 15:12:10 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:12:10 user devstack@n-api.service[64453]: Tue Nov 21 15:12:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd (ip 10.0.0.210) !!! Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:12:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 204 len: 0 microversion: 2.1 time: 0.128697 Nov 21 15:12:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 401/1200] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:12:10 2023] DELETE /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:10 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:11 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:12:11 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-90a3a62e-3d78-40b7-9f0a-51226c3e0e76 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 200 len: 1383 microversion: 2.1 time: 0.178348 Nov 21 15:12:11 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 402/1201] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:12:10 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 1383 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:12:11 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "name": "network-vif-unplugged", "status": "completed", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:12:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:11 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Creating event network-vif-unplugged:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:12:11 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028412 Nov 21 15:12:11 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 399/1202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:12:12 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "name": "network-vif-deleted", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:12:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:12 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59014. Nov 21 15:12:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] Creating event network-vif-deleted:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:12:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039749 Nov 21 15:12:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 402/1203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:12:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7762f03-419c-428d-8fa9-c1e4f46360dd", "name": "network-vif-plugged", "status": "completed", "tag": "21baf7bf-7bbb-426e-9931-99d21c588806"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:12:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:12:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:12:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:12:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Creating event network-vif-plugged:21baf7bf-7bbb-426e-9931-99d21c588806 for instance e7762f03-419c-428d-8fa9-c1e4f46360dd on user Nov 21 15:12:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029210 Nov 21 15:12:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 403/1204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. Nov 21 15:13:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:13:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-917c7251-38d3-4ef9-b9c1-cec3bfbf4a17 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 404 len: 111 microversion: 2.1 time: 0.037080 Nov 21 15:13:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 400/1205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:13:01 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. Nov 21 15:13:01 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:13:01 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-3039566c-473e-4f5f-8c37-942a8c57851d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 404 len: 111 microversion: 2.1 time: 0.042324 Nov 21 15:13:01 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 403/1206] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:13:01 2023] DELETE /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. Nov 21 15:13:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance e7762f03-419c-428d-8fa9-c1e4f46360dd could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:13:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-1c039196-8451-4a8b-8646-bc78bc42c664 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd" status: 404 len: 111 microversion: 2.1 time: 0.032133 Nov 21 15:13:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 404/1207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:13:01 2023] GET /compute/v2.1/servers/e7762f03-419c-428d-8fa9-c1e4f46360dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:13:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-9efd307e-9e10-4219-b946-a83c68206a87 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: .version_select at 0x7f76b0e7de10>, body: {"keypair": {"name": "tempest-keypair-481022832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPQsQLlzFgC4IyLTx79lLwEVcsds2id0bKLgF2DNW+VzzCfXJc2tu0zxZnQQ3n1vJ4nPAZgrTYCE/GhO5ptEWdQhiLAYa0gShWCItZnj8i6yRcAOvQyX1zkdBjOBsWhxQ=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:13:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:12 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-9efd307e-9e10-4219-b946-a83c68206a87 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:13:12 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-9efd307e-9e10-4219-b946-a83c68206a87 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:13:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-9efd307e-9e10-4219-b946-a83c68206a87 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.265455 Nov 21 15:13:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 401/1208] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 15:13:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:13:13 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1961082268", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "80a6a968-8bac-42a1-ab9f-f143b76c8677", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}], "security_groups": [{"name": "tempest-securitygroup--1374135926"}], "key_name": "tempest-keypair-481022832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:13:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:13 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:13 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:13:14 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80a6a968-8bac-42a1-ab9f-f143b76c8677',volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:13:14 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.935513 Nov 21 15:13:14 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 404/1209] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:13:13 2023] POST /compute/v2.1/servers => generated 404 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:13:14 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-35004c6c-7ba9-4112-9a90-d04032a4e54d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:13:14 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-35004c6c-7ba9-4112-9a90-d04032a4e54d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:13:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:14 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:14 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-35004c6c-7ba9-4112-9a90-d04032a4e54d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:13:14 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-35004c6c-7ba9-4112-9a90-d04032a4e54d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 200 len: 1087 microversion: 2.1 time: 0.070265 Nov 21 15:13:14 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 405/1210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:13:14 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:13:16 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:13:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:16 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Creating event network-changed:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:13:16 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086147 Nov 21 15:13:16 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 402/1211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:13:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "name": "network-vif-plugged", "status": "completed", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:24 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Creating event network-vif-plugged:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:13:24 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048986 Nov 21 15:13:24 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 405/1212] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "name": "network-vif-plugged", "status": "completed", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:13:26 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:13:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Creating event network-vif-plugged:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:13:26 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040383 Nov 21 15:13:26 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 406/1213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:14:04 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:14:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-afecb747-aed7-4b15-8c47-65d1cbecc8fc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 200 len: 1439 microversion: 2.1 time: 0.202272 Nov 21 15:14:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 403/1214] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:14:04 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 1439 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:04 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:04 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-f2a41711-679b-47bc-b7f1-e0612c02ee01 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.180918 Nov 21 15:15:04 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 406/1215] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 15:15:04 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:15:05 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:15:05 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:15:05 user devstack@n-api.service[64452]: Tue Nov 21 15:15:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Creating event network-changed:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:15:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051875 Nov 21 15:15:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 407/1216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:05 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:06 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:15:06 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c5249d38-1863-47ca-b35f-b1995a4aa717 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 200 len: 1439 microversion: 2.1 time: 0.212615 Nov 21 15:15:06 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 404/1217] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:15:05 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 1439 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1245556934"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:06 user devstack@n-api.service[64453]: INFO nova.compute.api [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Attempting to quiesce instance before volume snapshot. Nov 21 15:15:06 user devstack@n-api.service[64453]: INFO nova.compute.api [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 21 15:15:06 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Creating snapshot from volume 80a6a968-8bac-42a1-ab9f-f143b76c8677. {{(pid=64453) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 21 15:15:08 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-845a05b9-8605-4e59-89ce-8fa100884395 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/action" status: 202 len: 0 microversion: 2.1 time: 2.658405 Nov 21 15:15:08 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 407/1218] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 21 15:15:06 2023] POST /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/action => generated 0 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 21 15:15:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-ac25553a-d222-423c-9632-e6373e2027c9 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: .version_select at 0x7f76b0d6cc10>, body: {"keypair": {"name": "tempest-keypair-2140641823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDi/jctDH6D7WcdwWCM3fNQJ6wplSIEQwo0qoiIz7OjM+lWtcj/1TTYy3q0ng+i5eF0YGzLnGsFOFgFVcg7kiIabyo7iJbH4788bSJQtGvadi8l2Wy4XhVmDeH+tB4PKQ=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:08 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47504. Nov 21 15:15:09 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ac25553a-d222-423c-9632-e6373e2027c9 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:15:09 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-ac25553a-d222-423c-9632-e6373e2027c9 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:15:09 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-ac25553a-d222-423c-9632-e6373e2027c9 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119782 Nov 21 15:15:09 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 408/1219] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 15:15:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-711076728", "imageRef": "8f4e9b88-f049-4a3a-b80b-48fdf439ec97", "flavorRef": "1", "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}], "security_groups": [{"name": "tempest-securitygroup--591947734"}], "key_name": "tempest-keypair-2140641823", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:15:10 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9326012d-515c-4f63-bb9b-3931fa09bdde',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:15:10 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.595297 Nov 21 15:15:10 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 405/1220] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:15:10 2023] POST /compute/v2.1/servers => generated 403 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:15:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-59400531-54ff-4ea1-a222-d4d22d494f3d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:15:10 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-59400531-54ff-4ea1-a222-d4d22d494f3d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:15:10 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-59400531-54ff-4ea1-a222-d4d22d494f3d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:15:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-59400531-54ff-4ea1-a222-d4d22d494f3d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 200 len: 1245 microversion: 2.1 time: 0.068569 Nov 21 15:15:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 408/1221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:15:10 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:15:13 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:13 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Creating event network-changed:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:15:13 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032149 Nov 21 15:15:13 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 409/1222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "name": "network-vif-plugged", "status": "completed", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:26 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Creating event network-vif-plugged:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:15:26 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105963 Nov 21 15:15:26 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 406/1223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:15:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "name": "network-vif-plugged", "status": "completed", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:15:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:15:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Creating event network-vif-plugged:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:15:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046014 Nov 21 15:15:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 409/1224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:15:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:16:00 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:16:01 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:16:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-f045ea35-232c-41a4-a70a-1046af42472b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 200 len: 1596 microversion: 2.1 time: 0.337222 Nov 21 15:16:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 410/1225] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:16:00 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 1596 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:01 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:01 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-df3e18ed-266c-42f0-bf19-b9af2e483efe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.300585 Nov 21 15:17:01 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 407/1226] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 15:17:01 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c/os-interface => generated 282 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Creating event network-changed:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:17:02 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095143 Nov 21 15:17:02 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 410/1227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:17:02 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a44df148-1d08-4bef-9d19-4b05d7bb1acc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 200 len: 1596 microversion: 2.1 time: 0.299261 Nov 21 15:17:02 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 411/1228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:17:02 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 1596 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:17:02 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 204 len: 0 microversion: 2.1 time: 0.116362 Nov 21 15:17:02 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 408/1229] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:17:02 2023] DELETE /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:02 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:03 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "name": "network-vif-unplugged", "status": "completed", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:03 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Creating event network-vif-unplugged:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:17:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078891 Nov 21 15:17:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 412/1230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:03 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:17:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7767b687-d4d3-412e-ba53-03bda1f55947 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 200 len: 1720 microversion: 2.1 time: 0.341021 Nov 21 15:17:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 411/1231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:17:02 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 1720 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:17:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "name": "network-vif-deleted", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] Creating event network-vif-deleted:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:17:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077156 Nov 21 15:17:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 409/1232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:05 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecd145a-439f-4c61-a060-500b8404964c", "name": "network-vif-plugged", "status": "completed", "tag": "da77078d-d23d-4b8e-a51f-5111a1c4d11c"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:05 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Creating event network-vif-plugged:da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance 3ecd145a-439f-4c61-a060-500b8404964c on user Nov 21 15:17:05 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029787 Nov 21 15:17:05 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 413/1233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:53 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=8 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. Nov 21 15:17:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:17:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-c150e587-7a81-414c-9f42-81f190fdacaa tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 404 len: 111 microversion: 2.1 time: 0.038592 Nov 21 15:17:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 412/1234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:17:53 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:17:56 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:56 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:17:56 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 204 len: 0 microversion: 2.1 time: 0.123906 Nov 21 15:17:56 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 410/1235] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:17:56 2023] DELETE /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=10 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:56 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "name": "network-vif-unplugged", "status": "completed", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:56 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Creating event network-vif-unplugged:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:17:57 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:17:57 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6edbbcc5-2bcc-4471-b5e3-459333d6ae6f tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 200 len: 1563 microversion: 2.1 time: 0.320260 Nov 21 15:17:57 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 414/1236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:17:56 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 1563 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:17:57 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087963 Nov 21 15:17:57 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 413/1237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:17:59 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "name": "network-vif-plugged", "status": "completed", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:17:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:17:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:17:59 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:17:59 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39544. Nov 21 15:17:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Creating event network-vif-plugged:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:17:59 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Nov 21 15:17:59 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 411/1238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:17:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:18:01 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e4f63e-87bc-4e34-8200-6290d2f2fbf6", "name": "network-vif-deleted", "tag": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:18:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:01 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] Creating event network-vif-deleted:12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 on user Nov 21 15:18:01 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028759 Nov 21 15:18:01 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 415/1239] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39536. Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:18:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-256687be-6cc8-40bd-8cd7-74b40cdef41d tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 404 len: 111 microversion: 2.1 time: 0.036093 Nov 21 15:18:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 414/1240] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:18:47 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. Nov 21 15:18:47 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:18:47 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-143c48c5-8f07-40d3-ab60-372888cd839c tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 404 len: 111 microversion: 2.1 time: 0.038816 Nov 21 15:18:47 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 412/1241] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:18:47 2023] DELETE /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=8 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. Nov 21 15:18:47 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 3ecd145a-439f-4c61-a060-500b8404964c could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:18:47 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3fd4052a-055a-4f64-a1e3-9abf72fae5e7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c" status: 404 len: 111 microversion: 2.1 time: 0.039253 Nov 21 15:18:47 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 416/1242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:18:47 2023] GET /compute/v2.1/servers/3ecd145a-439f-4c61-a060-500b8404964c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:18:47 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-739048f9-84c5-487e-85b0-c5fedd7141e5 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '.version_select at 0x7f76b1276b90>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:47 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-739048f9-84c5-487e-85b0-c5fedd7141e5 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140641823" status: 202 len: 0 microversion: 2.1 time: 0.031790 Nov 21 15:18:47 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 415/1243] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 15:18:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140641823 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:18:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-434439db-6cc5-48ff-949e-37cbb849f6ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 404 len: 111 microversion: 2.1 time: 0.024817 Nov 21 15:18:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 413/1244] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:18:48 2023] DELETE /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. Nov 21 15:18:48 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:18:48 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-d1a65bb1-bb01-4fa4-acbd-8a7659122eda tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6" status: 404 len: 111 microversion: 2.1 time: 0.025407 Nov 21 15:18:48 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 417/1245] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:18:48 2023] GET /compute/v2.1/servers/15e4f63e-87bc-4e34-8200-6290d2f2fbf6 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:18:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-6fa2de45-7177-4f99-98f9-82b78bdceb90 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '.version_select at 0x7f76b11ef760>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-6fa2de45-7177-4f99-98f9-82b78bdceb90 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481022832" status: 202 len: 0 microversion: 2.1 time: 0.021472 Nov 21 15:18:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 416/1246] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 21 15:18:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481022832 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-56cc2654-09ff-4b33-b370-24de33f0ba89 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: .version_select at 0x7f76b0e7dbd0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-74226086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw=="}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-56cc2654-09ff-4b33-b370-24de33f0ba89 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:18:48 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-56cc2654-09ff-4b33-b370-24de33f0ba89 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'key_pairs'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:18:48 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-56cc2654-09ff-4b33-b370-24de33f0ba89 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.050478 Nov 21 15:18:48 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 414/1247] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 15:18:48 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1798000725", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1544898309"}], "block_device_mapping_v2": [{"uuid": "13e58418-c558-4685-a396-2867666c5e76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-74226086", "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}]}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64452) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64452) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:18:55 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13e58418-c558-4685-a396-2867666c5e76',volume_size=None,volume_type=None)] {{(pid=64452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:18:56 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.754511 Nov 21 15:18:56 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 418/1248] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:18:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:18:56 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-ecfb351e-0249-466a-a589-47ef89e384ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:18:56 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-ecfb351e-0249-466a-a589-47ef89e384ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:18:56 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-ecfb351e-0249-466a-a589-47ef89e384ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:18:56 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-ecfb351e-0249-466a-a589-47ef89e384ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 200 len: 1086 microversion: 2.1 time: 0.079421 Nov 21 15:18:56 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 417/1249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:18:56 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 1086 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:18:58 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:18:58 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:18:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:18:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:18:58 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:18:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Creating event network-changed:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:18:58 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080538 Nov 21 15:18:58 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 415/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:18:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:19:08 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:19:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:19:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045945 Nov 21 15:19:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 419/1251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:19:10 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:19:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:19:10 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036431 Nov 21 15:19:10 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 418/1252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:19:46 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:19:46 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-3c013e6a-a7aa-4741-a4ef-1bda8aff6237 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 200 len: 1438 microversion: 2.1 time: 0.245111 Nov 21 15:19:46 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 416/1253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:19:46 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 1438 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:20:46 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:46 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:20:46 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8b570b31-47d7-4221-bb01-d72cf0ca2b23 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 200 len: 1438 microversion: 2.1 time: 0.518997 Nov 21 15:20:46 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 420/1254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:20:46 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 1438 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:20:48 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Creating event network-changed:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038167 Nov 21 15:20:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 419/1255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:49 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:20:49 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 204 len: 0 microversion: 2.1 time: 0.120874 Nov 21 15:20:49 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 417/1256] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:20:49 2023] DELETE /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:49 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46326. Nov 21 15:20:49 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:20:49 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-1b27696b-a95e-459b-be87-10d119df5698 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 200 len: 1563 microversion: 2.1 time: 0.274467 Nov 21 15:20:49 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 421/1257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:20:49 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 1563 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:20:49 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-unplugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:20:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:49 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Creating event network-vif-unplugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:49 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028682 Nov 21 15:20:49 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 420/1258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:20:51 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-deleted", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:20:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:51 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] Creating event network-vif-deleted:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 Nov 21 15:20:51 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 418/1259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:20:51 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}, {"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}, {"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}, {"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-unplugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}, {"server_uuid": "1a7daa09-d3b6-4c97-96ac-fcca6f29d762", "name": "network-vif-plugged", "status": "completed", "tag": "3db6ecac-fd5e-44a9-9064-82ad60714880"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:20:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:20:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:20:51 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Creating event network-vif-unplugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Creating event network-vif-plugged:3db6ecac-fd5e-44a9-9064-82ad60714880 for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 on user Nov 21 15:20:51 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037056 Nov 21 15:20:51 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 422/1260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:39 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35262. Nov 21 15:21:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. Nov 21 15:21:39 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:21:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-513e68c3-b4e5-45ee-8299-b8ae4e82b4f8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 404 len: 111 microversion: 2.1 time: 0.042441 Nov 21 15:21:39 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 421/1261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:21:39 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:21:39 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:39 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702719148", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1544898309"}], "block_device_mapping_v2": [{"uuid": "13e58418-c558-4685-a396-2867666c5e76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-74226086", "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}]}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:21:39 user devstack@n-api.service[64454]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64454) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.quota [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64454) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:21:40 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13e58418-c558-4685-a396-2867666c5e76',volume_size=None,volume_type=None)] {{(pid=64454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:21:40 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.910050 Nov 21 15:21:40 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 419/1262] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:21:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:21:40 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 21 15:21:40 user devstack@n-api.service[64452]: Tue Nov 21 15:21:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db (ip 10.0.0.210) !!! Nov 21 15:21:40 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:40 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=14 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:40 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-2456057d-c657-4d0e-9190-e566d94530a8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:21:40 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-2456057d-c657-4d0e-9190-e566d94530a8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:21:40 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-2456057d-c657-4d0e-9190-e566d94530a8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:21:40 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-2456057d-c657-4d0e-9190-e566d94530a8 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 200 len: 1085 microversion: 2.1 time: 0.135562 Nov 21 15:21:40 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 423/1263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:21:40 2023] GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 1085 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:21:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Creating event network-changed:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:21:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Nov 21 15:21:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 422/1264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "name": "network-vif-plugged", "status": "completed", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Creating event network-vif-plugged:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:21:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058600 Nov 21 15:21:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 420/1265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "name": "network-vif-plugged", "status": "completed", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:21:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:21:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Creating event network-vif-plugged:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:21:52 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032905 Nov 21 15:21:52 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 424/1266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:22:30 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:22:30 user devstack@n-api.service[64453]: Tue Nov 21 15:22:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db (ip 10.0.0.210) !!! Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:22:30 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:22:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-dd20efbc-cfa6-40b2-a299-490889f5cdcc tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 200 len: 1437 microversion: 2.1 time: 0.263980 Nov 21 15:22:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 423/1267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:22:30 2023] GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 1437 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:23:30 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:23:30 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:23:30 user devstack@n-api.service[64454]: Tue Nov 21 15:23:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db (ip 10.0.0.210) !!! Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:31 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:23:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-f8de7607-760d-4a01-b225-cab8411a69ad tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 200 len: 1437 microversion: 2.1 time: 0.309942 Nov 21 15:23:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 421/1268] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:23:30 2023] GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 1437 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:23:32 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:23:32 user devstack@n-api.service[64452]: Tue Nov 21 15:23:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Creating event network-changed:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:23:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093940 Nov 21 15:23:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 425/1269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:23:37 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:23:37 user devstack@n-api.service[64453]: Tue Nov 21 15:23:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 15:23:37 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:37 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:37 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1408803984", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1544898309"}], "block_device_mapping_v2": [{"uuid": "d4c85311-5c93-4c65-b1fe-54c50cc12db3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-74226086", "networks": [{"uuid": "b528d921-8d48-4a36-8fdb-d38b79d20a80"}]}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] validate_networks() for [('b528d921-8d48-4a36-8fdb-d38b79d20a80', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting quotas for user 27e5950baa034e029e5db136635acd29 and project 52b11227090b4d16929bdc1b9d2e8c16. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:23:38 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4c85311-5c93-4c65-b1fe-54c50cc12db3',volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:23:39 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.149986 Nov 21 15:23:39 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 424/1270] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:23:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:23:39 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-ffc542ec-223c-4517-ac4b-e0560b1d2a42 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:23:39 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-ffc542ec-223c-4517-ac4b-e0560b1d2a42 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:23:39 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33564. Nov 21 15:23:39 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-ffc542ec-223c-4517-ac4b-e0560b1d2a42 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:23:39 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-ffc542ec-223c-4517-ac4b-e0560b1d2a42 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 200 len: 1086 microversion: 2.1 time: 0.070830 Nov 21 15:23:39 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 422/1271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:23:39 2023] GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 1086 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:23:41 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:23:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:41 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Creating event network-changed:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:23:41 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079409 Nov 21 15:23:41 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 426/1272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:23:48 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "name": "network-vif-plugged", "status": "completed", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:23:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:48 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Creating event network-vif-plugged:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:23:48 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Nov 21 15:23:48 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 425/1273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "name": "network-vif-plugged", "status": "completed", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:23:50 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:23:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Creating event network-vif-plugged:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:23:50 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 Nov 21 15:23:50 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 423/1274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:24:29 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:24:29 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a9b77e2f-8f17-444b-a312-6f168499b7ea tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 200 len: 1439 microversion: 2.1 time: 0.244766 Nov 21 15:24:29 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 427/1275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:24:29 2023] GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 1439 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:29 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:30 user devstack@n-api.service[64453]: DEBUG nova.policy [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64453) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:25:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-70647f12-86bf-4398-9a47-9d40351b23d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 200 len: 1439 microversion: 2.1 time: 0.658309 Nov 21 15:25:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 426/1276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:25:29 2023] GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 1439 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:31 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Creating event network-changed:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:25:31 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036813 Nov 21 15:25:31 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 424/1277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:32 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Going to try to terminate instance {{(pid=64452) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:25:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:25:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Creating event network-changed:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:25:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082510 Nov 21 15:25:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 427/1278] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:25:32 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 204 len: 0 microversion: 2.1 time: 0.116815 Nov 21 15:25:32 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 428/1279] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:25:32 2023] DELETE /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:32 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:25:32 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-df5f0512-196e-4491-bd2e-b844f080e804 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 200 len: 1564 microversion: 2.1 time: 0.231844 Nov 21 15:25:32 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 425/1280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:25:32 2023] GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 1564 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:25:33 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "name": "network-vif-unplugged", "status": "completed", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:25:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:33 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Creating event network-vif-unplugged:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:25:33 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029704 Nov 21 15:25:33 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 428/1281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:25:35 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "name": "network-vif-plugged", "status": "completed", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}, {"server_uuid": "944e2207-ff51-45e6-a803-d7191a3d2a77", "name": "network-vif-deleted", "tag": "a3e33ccf-94ae-44a5-b4c7-338013c32c79"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:25:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:25:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:25:35 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:25:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Creating event network-vif-plugged:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:25:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Creating event network-vif-deleted:a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance 944e2207-ff51-45e6-a803-d7191a3d2a77 on user Nov 21 15:25:35 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028994 Nov 21 15:25:35 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 429/1282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 944e2207-ff51-45e6-a803-d7191a3d2a77 could not be found. Nov 21 15:26:23 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 944e2207-ff51-45e6-a803-d7191a3d2a77 could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:26:23 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-249454b5-f8a8-4de6-9efe-cf93cc8df4d6 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77" status: 404 len: 111 microversion: 2.1 time: 0.080657 Nov 21 15:26:23 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 426/1283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:26:23 2023] GET /compute/v2.1/servers/944e2207-ff51-45e6-a803-d7191a3d2a77 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:30 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=10 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Going to try to terminate instance {{(pid=64453) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:26:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Creating event network-changed:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:26:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048735 Nov 21 15:26:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 430/1284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:26:30 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 204 len: 0 microversion: 2.1 time: 0.126912 Nov 21 15:26:30 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 429/1285] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:26:30 2023] DELETE /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:26:30 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-21f1f012-f7c7-4a57-aa37-bb7ad78ee675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 200 len: 1561 microversion: 2.1 time: 0.216305 Nov 21 15:26:30 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 427/1286] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:26:30 2023] GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "name": "network-vif-unplugged", "status": "completed", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Creating event network-vif-unplugged:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:26:30 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033637 Nov 21 15:26:30 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 431/1287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:26:32 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "name": "network-vif-plugged", "status": "completed", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}, {"server_uuid": "2de0e971-a800-4d42-a52c-f3bdac3684db", "name": "network-vif-deleted", "tag": "da4ed636-a1fc-421c-9645-a79d438fdaf1"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:26:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:26:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:26:32 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:26:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Creating event network-vif-plugged:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:26:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Creating event network-vif-deleted:da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance 2de0e971-a800-4d42-a52c-f3bdac3684db on user Nov 21 15:26:32 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030367 Nov 21 15:26:32 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 430/1288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=4 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=8 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.wsgi [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 2de0e971-a800-4d42-a52c-f3bdac3684db could not be found. Nov 21 15:27:20 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 2de0e971-a800-4d42-a52c-f3bdac3684db could not be found. {{(pid=64454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:27:20 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-512b8f7b-7ad3-4d85-a7b4-283538f29256 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db" status: 404 len: 111 microversion: 2.1 time: 0.031533 Nov 21 15:27:20 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 428/1289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:27:20 2023] GET /compute/v2.1/servers/2de0e971-a800-4d42-a52c-f3bdac3684db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:21 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60296. Nov 21 15:27:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.wsgi [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. Nov 21 15:27:21 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. {{(pid=64452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:27:21 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7a6a413b-7f36-41be-8024-ecff63e71ffe tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 404 len: 111 microversion: 2.1 time: 0.035658 Nov 21 15:27:21 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 432/1290] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:27:21 2023] DELETE /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:27:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HTTP exception thrown: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. Nov 21 15:27:21 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Returning 404 to user: Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:27:21 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-d07ecef8-4a05-4592-8e16-41a3c688cf8e tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762" status: 404 len: 111 microversion: 2.1 time: 0.035802 Nov 21 15:27:21 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 431/1291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:27:21 2023] GET /compute/v2.1/servers/1a7daa09-d3b6-4c97-96ac-fcca6f29d762 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 15:27:24 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-c8673064-be67-48c7-bcd8-e836dce39e24 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Calling method '.version_select at 0x7f76b0eb08b0>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:27:24 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-c8673064-be67-48c7-bcd8-e836dce39e24 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-74226086" status: 202 len: 0 microversion: 2.1 time: 0.027811 Nov 21 15:27:24 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 429/1292] 10.0.0.210 () {62 vars in 1334 bytes} [Tue Nov 21 15:27:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-74226086 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:28:08 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:08 user devstack@n-api.service[64452]: Tue Nov 21 15:28:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 21 15:28:08 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:08 user devstack@n-api.service[64452]: Tue Nov 21 15:28:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 21 15:28:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:08 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:08 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-37b65c6b-daa2-42a0-ac77-d41cb87084bb tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: .version_select at 0x7f76b0d6c310>, body: {"keypair": {"name": "tempest-keypair-1612647852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1oeHY/5rN1gUrkAKf/4+33RT7/k37VGtmoc5W/wbQ4jyH7nbMrWDqOGR+N2bB54lcmqY01foylD3tqGegEUEJxZhiU4MOwIyw/1hCYuK0+/Hve3EzLI3dEW2K0lYOjw=="}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:28:08 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-37b65c6b-daa2-42a0-ac77-d41cb87084bb tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting quotas for project 499fb4b9492840f78205dc376e869d28. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:28:08 user devstack@n-api.service[64452]: DEBUG nova.quota [None req-37b65c6b-daa2-42a0-ac77-d41cb87084bb tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting quotas for user 0b231abfef6e430f869eca46aeb5d063 and project 499fb4b9492840f78205dc376e869d28. Resources: {'key_pairs'} {{(pid=64452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:28:08 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-37b65c6b-daa2-42a0-ac77-d41cb87084bb tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.297510 Nov 21 15:28:08 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 433/1293] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 21 15:28:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:28:11 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1145802285", "imageRef": "56f0cfc7-adc4-437a-accc-8a2f8cd4e785", "flavorRef": "1", "key_name": "tempest-keypair-1612647852", "security_groups": [{"name": "tempest-secgroup-smoke-1287327835"}, {"name": "tempest-securitygroup--1134300661"}], "networks": [{"uuid": "61623a42-185f-4a0f-ac9c-7d93ceb28acf"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:28:11 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:11 user devstack@n-api.service[64453]: Tue Nov 21 15:28:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 15:28:11 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:11 user devstack@n-api.service[64453]: Tue Nov 21 15:28:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 21 15:28:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:11 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:11 user devstack@n-api.service[64453]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] validate_networks() for [('61623a42-185f-4a0f-ac9c-7d93ceb28acf', None, None, None, None, None)] {{(pid=64453) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flavor limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Image limits 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flavor pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Image pref 0:0:0 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=64453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting quotas for project 499fb4b9492840f78205dc376e869d28. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.quota [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting quotas for user 0b231abfef6e430f869eca46aeb5d063 and project 499fb4b9492840f78205dc376e869d28. Resources: {'ram', 'cores', 'instances'} {{(pid=64453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Going to run 1 instances... {{(pid=64453) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 21 15:28:12 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=64453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 21 15:28:12 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 451 microversion: 2.1 time: 0.828746 Nov 21 15:28:12 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 432/1294] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 21 15:28:11 2023] POST /compute/v2.1/servers => generated 451 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 21 15:28:12 user devstack@n-api.service[64454]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:28:12 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:12 user devstack@n-api.service[64454]: Tue Nov 21 15:28:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb (ip 10.0.0.210) !!! Nov 21 15:28:12 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:28:12 user devstack@n-api.service[64454]: Tue Nov 21 15:28:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb (ip 10.0.0.210) !!! Nov 21 15:28:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:12 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:28:12 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-e695f903-89b8-421f-8ee1-f189309112cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:28:12 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-e695f903-89b8-421f-8ee1-f189309112cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:28:12 user devstack@n-api.service[64454]: DEBUG nova.policy [None req-e695f903-89b8-421f-8ee1-f189309112cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b231abfef6e430f869eca46aeb5d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499fb4b9492840f78205dc376e869d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64454) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:28:12 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-e695f903-89b8-421f-8ee1-f189309112cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 200 len: 1236 microversion: 2.1 time: 0.105701 Nov 21 15:28:12 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 430/1295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:28:12 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:28:15 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:28:15 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:28:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.compute.server_external_events [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Creating event network-changed:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:28:15 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043067 Nov 21 15:28:15 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 434/1296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:28:17 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "name": "network-vif-plugged", "status": "completed", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:28:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:28:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:28:17 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:28:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Creating event network-vif-plugged:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:28:17 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043404 Nov 21 15:28:17 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 433/1297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:28:19 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "name": "network-vif-plugged", "status": "completed", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:28:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:28:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:28:19 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:28:19 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] [a289631f-2caa-4db2-a45d-e3595548742d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42160. Nov 21 15:28:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Creating event network-vif-plugged:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:28:19 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040457 Nov 21 15:28:19 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 431/1298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:28:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell0:SELECT=4 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:29:02 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:29:03 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b231abfef6e430f869eca46aeb5d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499fb4b9492840f78205dc376e869d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:29:03 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-40d20de3-0922-4630-85ab-0e7295ed4cca tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 200 len: 1595 microversion: 2.1 time: 0.477160 Nov 21 15:29:03 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 435/1299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:29:02 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 1595 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell0:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64453]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:03 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:03 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-30c6fb85-3144-44ac-aefd-3860196ae4c2 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169020 Nov 21 15:30:03 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 434/1300] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 21 15:30:03 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:30:03 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:30:03 user devstack@n-api.service[64454]: Tue Nov 21 15:30:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 21 15:30:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell0:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:03 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:04 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:30:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:04 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Creating event network-changed:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:30:04 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288551 Nov 21 15:30:04 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 432/1301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:30:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:30:04 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b231abfef6e430f869eca46aeb5d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499fb4b9492840f78205dc376e869d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:30:04 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-6c438d50-a41d-4bf5-8c7e-1ba38a9355e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 200 len: 1595 microversion: 2.1 time: 0.276772 Nov 21 15:30:04 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 436/1302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:30:04 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 1595 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0014d9a-54c6-4350-9a98-c42b738737e0"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:07 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:07 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] [21836eec-fd11-48f0-a01c-5154124d29ee] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54232. Nov 21 15:30:07 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279065 Nov 21 15:30:07 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 435/1303] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 15:30:07 2023] POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:28 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'services' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:30:28 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/d0014d9a-54c6-4350-9a98-c42b738737e0" status: 202 len: 0 microversion: 2.1 time: 0.272768 Nov 21 15:30:28 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 433/1304] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:30:28 2023] DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/d0014d9a-54c6-4350-9a98-c42b738737e0 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:30:28 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:30:28 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-3a75579e-b936-4b4c-9e5e-3fb37de023e5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048490 Nov 21 15:30:28 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 437/1305] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:30:28 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:31:18 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:31:18 user devstack@n-api.service[64453]: Tue Nov 21 15:31:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments (ip 10.0.0.210) !!! Nov 21 15:31:18 user devstack@n-api.service[64453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:31:18 user devstack@n-api.service[64453]: Tue Nov 21 15:31:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments (ip 10.0.0.210) !!! Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=4 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:18 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:18 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-48290c68-45d1-48d8-9f13-c4c52dc6b8f0 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066615 Nov 21 15:31:18 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 436/1306] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:31:18 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 15:31:21 user devstack@n-api.service[64454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:31:21 user devstack@n-api.service[64454]: Tue Nov 21 15:31:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments (ip 10.0.0.210) !!! Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06219637-9551-4ac9-8d20-877de3340b2d"}} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283181 Nov 21 15:31:21 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 434/1307] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 15:31:21 2023] POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:31:30 user devstack@n-api.service[64452]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:30 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:31 user devstack@n-api.service[64452]: DEBUG nova.objects.instance [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'services' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=64452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:31:31 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/06219637-9551-4ac9-8d20-877de3340b2d" status: 202 len: 0 microversion: 2.1 time: 0.209481 Nov 21 15:31:31 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 438/1308] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:31:30 2023] DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/06219637-9551-4ac9-8d20-877de3340b2d => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:31:31 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:31:31 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-e751fa31-902b-4446-a8b1-0f4bd27b22cd tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055395 Nov 21 15:31:31 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 437/1309] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:31:31 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:21 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:21 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-8ca2591f-568f-4103-9220-38a3c0b0da18 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057029 Nov 21 15:32:21 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 435/1310] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:32:21 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26fe9f56-ae93-4cc8-be2d-8a872116ee3b"}} {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:24 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa4e8f76-9a5a-4ca0-bfdf-ed41e14f9955] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47464. Nov 21 15:32:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307433 Nov 21 15:32:24 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 439/1311] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 15:32:24 2023] POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:34 user devstack@n-api.service[64453]: DEBUG nova.objects.instance [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'services' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=64453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:32:34 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/26fe9f56-ae93-4cc8-be2d-8a872116ee3b" status: 202 len: 0 microversion: 2.1 time: 0.192511 Nov 21 15:32:34 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 438/1312] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:32:34 2023] DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/26fe9f56-ae93-4cc8-be2d-8a872116ee3b => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:32:34 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:32:34 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-cbe6e5da-f663-4ac2-af93-af0a7ecef824 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059514 Nov 21 15:32:34 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 436/1313] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:32:34 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:24 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:24 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-650c6c65-eb47-4da0-b12f-eb5e1db2e88f tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.212731 Nov 21 15:33:24 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 440/1314] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:33:24 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 25 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f23d52-d743-470a-bbf1-4b5e777edd44"}} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:27 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:27 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363255 Nov 21 15:33:27 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 439/1315] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 21 15:33:27 2023] POST /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=6 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:37 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:38 user devstack@n-api.service[64454]: DEBUG nova.objects.instance [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'services' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=64454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 21 15:33:38 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/65f23d52-d743-470a-bbf1-4b5e777edd44" status: 202 len: 0 microversion: 2.1 time: 0.196514 Nov 21 15:33:38 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 437/1316] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 21 15:33:37 2023] DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments/65f23d52-d743-470a-bbf1-4b5e777edd44 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:33:38 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:33:38 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-c7d95bc4-0847-4fba-b5e2-9e507d094c65 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Nov 21 15:33:38 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 441/1317] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:33:38 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:28 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:28 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-defda196-2525-486d-9b02-f0de51b35f27 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055294 Nov 21 15:34:28 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 440/1318] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 21 15:34:28 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_api:SELECT=2 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG dbcounter [-] [64454] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=64454) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64454) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:52 user devstack@n-api.service[64454]: DEBUG nova.compute.api [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Going to try to terminate instance {{(pid=64454) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 21 15:34:52 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 204 len: 0 microversion: 2.1 time: 0.128517 Nov 21 15:34:52 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 438/1319] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 21 15:34:52 2023] DELETE /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 15:34:52 user devstack@n-api.service[64452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 15:34:52 user devstack@n-api.service[64452]: Tue Nov 21 15:34:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb (ip 10.0.0.210) !!! Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG nova.compute.api [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64452) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:52 user devstack@n-api.service[64452]: DEBUG oslo_concurrency.lockutils [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64452) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=6 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "name": "network-vif-unplugged", "status": "completed", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:53 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.compute.server_external_events [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Creating event network-vif-unplugged:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:34:53 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120643 Nov 21 15:34:53 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 441/1320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:34:53 user devstack@n-api.service[64452]: DEBUG nova.policy [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b231abfef6e430f869eca46aeb5d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499fb4b9492840f78205dc376e869d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=64452) authorize /opt/stack/nova/nova/policy.py:203}} Nov 21 15:34:53 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-8f5aeeea-80ab-44f1-9a80-1bb22d185761 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 200 len: 1719 microversion: 2.1 time: 0.459240 Nov 21 15:34:53 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 442/1321] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:34:52 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 1719 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 15:34:55 user devstack@n-api.service[64454]: DEBUG nova.api.openstack.wsgi [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "name": "network-vif-plugged", "status": "completed", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}, {"server_uuid": "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb", "name": "network-vif-deleted", "tag": "c7291df2-b001-4983-a875-118cf94bdbd5"}]} {{(pid=64454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 15:34:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:34:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:34:55 user devstack@n-api.service[64454]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64454) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:34:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Creating event network-vif-plugged:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:34:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.compute.server_external_events [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Creating event network-vif-deleted:c7291df2-b001-4983-a875-118cf94bdbd5 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb on user Nov 21 15:34:55 user devstack@n-api.service[64454]: INFO nova.api.openstack.requestlog [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041690 Nov 21 15:34:55 user devstack@n-api.service[64454]: [pid: 64454|app: 0|req: 439/1322] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 21 15:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_api:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG dbcounter [-] [64453] Writing DB stats nova_cell1:SELECT=2 {{(pid=64453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '>' {{(pid=64453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG nova.compute.api [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Fetching instance by UUID {{(pid=64453) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG oslo_concurrency.lockutils [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "ff78a6a6-5ef0-4832-8292-72647bc96a63" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=64453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 21 15:35:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.wsgi [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] HTTP exception thrown: Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb could not be found. Nov 21 15:35:43 user devstack@n-api.service[64453]: DEBUG nova.api.openstack.wsgi [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Returning 404 to user: Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb could not be found. {{(pid=64453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 15:35:43 user devstack@n-api.service[64453]: INFO nova.api.openstack.requestlog [None req-cb504ca9-2ebf-4890-8553-b761005d08c6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" status: 404 len: 111 microversion: 2.1 time: 0.035529 Nov 21 15:35:43 user devstack@n-api.service[64453]: [pid: 64453|app: 0|req: 442/1323] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 21 15:35:43 2023] GET /compute/v2.1/servers/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 15:35:43 user devstack@n-api.service[64452]: DEBUG nova.api.openstack.wsgi [None req-a40b3f44-2ba6-4a9d-a766-03a1c915e75d tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Calling method '.version_select at 0x7f76b0eb5ab0>' {{(pid=64452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 15:35:43 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_api:SELECT=2 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:35:43 user devstack@n-api.service[64452]: DEBUG dbcounter [-] [64452] Writing DB stats nova_cell1:SELECT=6 {{(pid=64452) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 21 15:35:43 user devstack@n-api.service[64452]: INFO nova.api.openstack.requestlog [None req-a40b3f44-2ba6-4a9d-a766-03a1c915e75d tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612647852" status: 202 len: 0 microversion: 2.1 time: 0.024692 Nov 21 15:35:43 user devstack@n-api.service[64452]: [pid: 64452|app: 0|req: 443/1324] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 21 15:35:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612647852 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)